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ABSTEACT 

The preliminary results of four of sl^ research 
methodologies used to evaluate a professional development curriculum 
in an urban BChobl are deacfibed and reported* The paper begins with 
a diacuasion of tie social systems model underlying tie project^ a 
brief summary of the transactional evaluatidn acheme used to direct 
reaearch efforts^ a description of the inservice teacher education 
component of the program^ and then an explanation aad preliminary 
report of the findinga of each of the four methodologfies. Each 
methodology ia analyzed in terms of the data^it yielda* its^^.^^^^ 
generation of research guestions, and Its^on 

specific bodies of knowledge* The four methodologies covered in order 
arei (1) Quantitative and Psychometric Analysis^ (2) Ethnographic 
Analysis^ (3) Historical^ and (4) Managerial Analysis* The two 
methodologies not r<bported here ^ but used in the project- are the 
Comparative Case study approach and the Classroom learning 
Environments Studies* -The paper concludes with a discussion of the 
coat 'benef ita of the four methodologies under conaideratio^* Pinallyj 
the implications for assessing aQja programa in other areas are 
presented. (Author/fiC) " ^ v:^- 
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I. Ch/erviaw and Purposes of Paper 

The paper describes and reports the preliminary results of four of six re- 
search aethodologlea used to evaltiata a profeaslonal developraeiit eurriculum In 
an urbatt ac'hool* The paper begins irtth a diseussion of the soeial aystams !nod« 
el underlying the project , a brtef auEomary of the transactional evaluation 
scheme used to direct research efforts ^ a description of the Inservice teacher 
education component of tBie prograca/ and then an explanation and prellsiinary re« 
port of tha flndinga of each of the four methodologies* Each methodology Is a- 
naly^ed in tarms of the data it yields^ its .genaratlan of research questions^ 
and its contribution to general and specific bodies of knowledge* The four 
methodologies covarad tm order are r (1) Quantitative and Psychometric Analysis, 
(2) Ethnographic Analysis, (3) Hlstarlcalp ariid (4) Managerial ^alysls. The two 
methodologlag not repoiftad on herap but used in the pTOjact, are the CoEqiarative 
Caie Study approach aind the ClasaraoDft Learning Invlronment Studies* Both of 
these are planned for -the second and surEmatlve year of the projact* 

Mora Bpeclficallys the paper willi 

1, Describe in aumary faslon the conceptual base, the goals of the pro- 
ject and the nature of the multl^facetad curriculum. 

2* Discuss the transactional operating style of the prografti and document 
the necessity for using a traniacttenal evaluation approach ' lit this 
urban professional development program. 

3, Outline the specific appllf.ation off the four methodologies Co various 
aspeota of the progratit and provide m rationale for using each* - 

4* Report the results of ^aclY evaluation method briefly and indlcaita 
which iDay be eKpandedj maintained and modified^ 

5, Analyse the problems liwolved in sytithesl^ing the diita derived if roni 
a variety of techniques and analytical frameworks* 



R^ E., Stake. Evaluating the Art& in Educations A Responsive Approach 
(Columbufi^ Ohloi Charles Marrill, 1975) , 



The paper eoncludes with a dlsausiion of the ceet beniaflte of the four 
mathodQlogles undaE^ consideration/ Finally^ the ImplicatiOM for assessing 
c Duplex pt'ograms in other aire as are presented* 

A* The Cpiaplex Nature of the Program 

The gtneral model of behavior underlying thtt Cycle 11 Teacher CoTpS pro- 
gram li the open aoclD-cultural ayetena framawork of GetEels and Guba shown be- 
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Three basic assumptions are made by the frameworks First^ each school is 
a unique social system aharacteriEed by institutional role aets and filled by 
personalities with individual needs. New persons coming int^^ a system must 
learn the institutional eKpeotations to function in their roles, and in some 
ways institutions must have the flexibility to accosBnodate Individual needs. 



^J, Qetiels,, Gan^beil and Linham> Educational Administrati on As a 
Social Proceagr Theory. Research, Practice , (Not York i Harper ^ Rw, 1968) 
p; 105. 



Fut another way, mn effactive and efficient orgaitiEation nmnagemenc miniMges 
the conflict bettjeen institutional expectations and Individual needs by adopt* 
Ing a tf ansactional style of organisational management. The prograi^Mtlc 
implications of this assumption arai to train togetheir the persoM \Ao are and 
will be filling the rsles in a specific school coranunt£y| to transirtt and tte- 
gotlata sinillar institutional axpectatloni with them befdre changing cosponenta 
of the system^ ^*8«f the Introduction /of a major currleular ptojeety and to 
continue the reinf or ceiaent of goals ^d the satisfaction of Indtvlduai needs 
through the professional training program. 

The second assumption of the model relatei to the specification of role 
esqpactationa when more thm one agency is Involved in the system. An effective 
program must be a collaborative one Involving the major Institutions In the 
achpol/communlty. Thm program should develop a participatory declslon^ffl^ing 
model Incorporating input from the university^ the public schools, the parents^ 
the local community^ the students and the teachers and their tepresentatlve 
organisations* ^ird* at the Individual level of the modalp the greater the " 
communication and interaction among the actors telthiri the system the greater 
the effectiveness and efficiency of the system. The Implication of this as- 
sumption is that the program should institute procedures to Increase contact 
and enhance the relatlonahlps of the individuals filling the roles In the 
school/community g The R. U* Teacher Corps program based on these assumptions 
began Dpera**.ion In Junej 1976 and wlll terminate In June of 1978* 

The Hlnton Elementary School Teacher Learning Center and Cadre, funded by 
USOE Teacher Corps, Is a collaborative effort by Roosevelt Inivarslty, the 
Chicago^Publlc Schools and the Hinton Elementary School CoOTOoity to develop--^., 
better p^pcedures for retraining eKperlenced staff maimers, identifying and 



solving problem^ in the school, i^lemettttog innovative projects and providlag 
inicial training for the Teacher Corpi pre-se^ice interno, I^e program iu a 
ca^iex ona with many coaponenca, but the basic training Mchanism of the pro- 
gram is called a cadre, a group coi^osed of teachers^ adminis trators^ co^minity 
peraDnSs role specialisti and interne vlth Teacher Corps staff ambers guiding 
the direction of the group. The cadre meets weekly after school to work on 
the group specified goals and projects designed to l^rove instruction and, 
ultlraately, student performance at the school^ Addltionallyp daily inservica 
activities are offered by the Teacher Cqtpi prograa la various formats i formal 
large group instructional sessions presenting Infomation, new techniques and 
teaching strategies concerning metric education and diagnostic prescriptive _ 
teaching, small group meetings with staff, individual classroom consultation 
and availability of materials and resources in the Teacher Learning Center, 
A more cocr^lete description of the curriculum is presented below. 

B* T ^e Ineervice Curriculum ^r"^" 

The inservica program draws its direction feom.: three saparate^ but overlap- 
ping, models. It draws, firsts from Che social systema model described above, 
in that the identification of eKpectattons of one's own and others' role groups 
is assumed to underly all "nuts and bolts" kinds of teaching, curricular, and 
organizational Improvement tasks, and dealing with this role development must 
be attended to dlractry^^n-thi^pjcggrm^^ Inservice tfiacher 

education by Joyce, Howey and Yarger^, which prescribes teacher involvement In 
a governance process to make decisions about the substance, the delivery process 
and the mode of inaervice prograna , gave rise to stwctures and program outcomes 

- ''B, Joyce, K. Howey^ and Yarger, Issues to Face . ISTE Report I, Palo 
Alto^ California, June 1976, * 
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of the Inservics currlcylum. And ChlTd, we have used thdse uBlquitcniS aspeets 
of the Tyler model. In that we have specified objectives to be accD^llshed 
through an Inservlce ptogTom^ and are evaluating their actaln^nt* Of course, 
given the faculty involvement in th^ deetaion-m^ing process on an ongoing 
basis r s©M initial objectives are dropped and others not originally intended 
are added. Thus the process of evaluating original objactlves' attalroosnt be* 
comas clouded, 

If^lemen Cation of various aspects of the program is tlme^bound. The 
first major aetivlty was a three -'wedc, three hour per day, sumQer program pre«^ 
eaeding the first school year of the project^s Implementation, &;^er half 'of 
the faciulty, plus other role members, participated in the sumrar program* 
Each week's sasslons focused on a different theme* CTie first was titled, 
"Cross Role Training," and involved meetings in role groupa (prtaary and inter- 
mediate teachers, community represantattvas, parents^ praservlce interns, ad- 
ministrators, and university personnel) to clarify the functions of one -s own 
role. group and expectations for each other's role group* These perceived func- 
tions and eKpectatlons wera shared mong groups, and clarification discussions 
ensued for the purpose of attaining mutual understandings as a foundation for 
all future Inservlce werk. - 

/ The second weak had th^ thrust of Problem Solving attd Group Dynamics « At 
the (outset the Dewey model of problem-solving and its application to local 
school and community Issuei was presented. This was followed by an administra** 
tloft of two Instrumenta deslgncfJ to have Individuals assess their leadership 
and personal interaction styles and to eKam^lne their values regarding the teach- 
ing of Black studentSp The aim was to make e^llclt the set of personal styles 
and values as they affected each individual's functioning in problem- solvlr^l 

8n 



tasks In the schsol aiid coffirainity. Through a consensus btillding activity, par*' 
ticlpants were Co arrive at a com^a yiei^of problem areas. At tha end of the. 
weak the group evolved a sec of problems and related tHsks they wished to pur- 
sue for the coming school year, and -€ach IndividuaX made a cottiaittment to work- 
ing on one task group froca i^thin the range identified. 

Week three focused on the introduction of curricular areas on which the 
group had earlier Indicated they ^shed to have tnser^lce seaslons« The four 
top-priority areas were taken up^ one each day* Sesslona were presented by 
the university staff and outside coaaultants on Maitery Learning , Cpncinuoua 
Progress^ Metric Education and the Qiceptional Chlld^ '^ese topics were pre- 
faced with an introduction to ctirrleul™ design through the T^ler Rationale, 

During the 1976-77 school year, the inservice program consista of three 
concurrently operating, somewhat integrated, 'components. We have followed ^ 
upon these three in reaponse to the variability of time available, par tlct- 
panti}* subs tantlve Interests, and the motivational structures, of various par* 
tlcipants, ^e three components are: morning inservice sessions and follow* 
up conaultation in classes, weekly cadre meetings, and professional development 
courses* 

Sesslona which are very close to a traditional Inservice model are held 
twice weekly during one^half hour plannl^ periods on toplos Initially request- 
tea by the teachers, but atructured by the university faculty for the most part, 
Theae sesslona have concentrated on metric education and elements of diagnostic/ 
prescriptive teaching applied to several subject areaa. During their four 
months of operation thus far^ the ec^haaia In the sessions has shifted from 
didactic presentations by university faculty members to presentatlona by teach-| 
ere on their trial Ir^lementations of techniques applicable for different types f 



of scurfents. Thu nvore racent eCThasls has also been on in-class fonsultafclDn, 

wherein tha university fectilty saabers, upon requesc of teachers, parcictpate 

# 

in tlie teaetiers* classroosi activities as needed, Theae activiciea have in- 
cluded the actual teaching of laasons to chllcSren for the teacher to observe, 
individual student diagnosis of parcicular learning problems and suggested 
techniques to overcoro these , assistance with small group acclvlties, and ob- 
servation of the teacher and discus slon with her afterurards and follow-up 
planning* 

The second component of the Iniervlce curriculum t^as place In the weakly 
two and one-half hour after school cadre meetings. The cadre Is a g?ptip of 20 
Individuals representing each of the schooi/coTOunlty'a role grmipa mentioned 
above s which has the task of foOTulatlng ita own goals and wDrklng toward the 
solution of school problems* University faculty members participate in the 
cadre with their various coE^atencles upon request by the group, although one 
university faculty member is the eoordtnator of the cadre. Another university 
staff person functious as a nonparticipant observer and attends all niaatings* 
Specific^ tasks to which this group has addraased itself includes the davalop- 
mant of a skill baric correlated to reading objectives, the clarification of and 
development of teacher-parent cofflmunlcatlon practices,- grading poliaiea within 
the school, the establishment of a newsletter to the school coEminity, consider- 
atlon of anthropological prlnclplas applied to urban educational settings, and 
the development of a catalogue of dlagnostlc/presGrlptlve teaching activities 
fleld*^ tested in the schoDl. 

Professional development graduate education courses are offered at the 

field site by university personnel connected with^the project as the third com- 

■■ " • — . ■ ' — ^ ■ — • ■ _ - ■ ■ ■ 

ponant of the Inservlce curriculum^ The majority of the members of these 



eouraeB axe the tamehera and g ch oo 1 /c gg^suul reprftieatatlvei it-m^ the ^itci 
school p alchough teachers arid paraproiesgionals froa nearby schools are also 
Caking the courses. The ge serai topics of these cmvnri^' arc mdrr spp ly to 
specific local prob less* Itic courses have consisted of* Adonis trat loo 
School/C^^jnlCy Relationships , Langya^a Ares in th^ Urbun School, and Hi^^ 
DovelopMnt and Che Exceptional Child* 

While the foregoing curriculim degcrlptloa presents only the bareit sketch 
of the activitlei taking place, it ghonld be evident that the progrsm is^lti- 
faceted. The evaluation of the program for both formative and euss^tlve pur- 
poses tB therefore a cMpleK taik^ for effects of varlmis aspects of the progiras 
are not easily Beparated and decisions to raake changes In one area affect other 
areas very quickly, 

C* The Problem of Evaluation and the Trang_agt_lonal Evaluation PeslRP 

The program described above la a co^le^ one not unlike other educational 
endeavors* Tlie problem Is^ how doeii one evaluate its many facets while cyilntaln- 
Ing program Integrity and the evaluators' objectivlcyt Hie research and evalu- 
ation design had to meet the folloNring criteria* The model had to provide data 
on each of the program coa^onents lAlle mlntaining* 

1, directtonj syntbesiSj coordination of the many parts being evaluated 
so that the overall dlrecclon of the program remains In rocua; 

2. methodologies appropriate for each individual e^^onent^ 

3* optlnial operation of the program in special aetclngs where evaluation 
is usually problematic (distrustj suapiclon of university typaaV over- 
helming, thought to interfere with school routine, raclailylnterp- 
retedj etc* ) 

4« procaduras ^ich are conceptually and thaoretlcally sound as Judged by 



th«0rle« about the program*^ fDcui of tnier*/i€€ €4ycAtlQ0 ^^elj for 
.■•rha design vhlch the pr^gts^. dcrvelap^era Judged b^it ths gb0?e criteria 

..... . . . . r^- - . 

irAS the trfms^cC:ion.al evalti^Slcm ^^el deicribid by Rippey and others * 
Briefly^ 

'''trsn.tactlcjo^l e'/slu^ntlon ii a develeplnj^ aspact of educational 
mceD*ai>iiibllt Ey.. It looks at th^. affects of ch^Agc^ progi*»3 
in ncho^^li' m%d other imti^ationm an che incunbeata of the 
roles In th^ ayace^ tif^arfoing chsi^ge, an the chM^ars 

£iiei^el*/c6» it d^ci not focui e«lufiively m the mit€^^# of 
the ehaaged program aa they affect a target po^ylatloQ* Fsr 
cx^^le: if a ichool ivscea- vie« plar^l^ tm inCrff^^luM a par- . 
fomAnce e0stracting sygtesi, r«Mae£lonal gvaluatios vmild 
lookj not at l^roving reading scoraa o£ $tu4anta, but at 
changed role «lsrioriships and latent appreheasloris amon^ 
those responslbifc for the educational sarvlecs - taachars, ad- 
sinistra tors and perhaps paranti. A cp^arlson vlth the tradi- 
tional su^^^tive and foraative evaluatlona ahow^ that tha tar- 
get of «V8lxjatlsn Is iiiinrent; th& aubjeet of the evaluation 
is tha system, not the cllant of the aer%*^ices rendered by tha 

Walberg axpandn the dcflnitisn by indtcating th^t ^ 

'^trai^aacttonal e%\nlunci0n ^ . , is the acqulaltltya and faed- 
back of information and voluM into an ongoing social systea 
to aiseaa^goali, means » asd their match irtthtn ^d outside the 
ayatesi* It is dlstinet from tradlttoaal evaluation in eduea- 
tion in tvo vaysi its focua is on tha social and organliation- 
al relatiatis rather than on edycatlon materials and techniques; 
and its t nsla is on diagnosis and t^rovcment of ,a aystem 
rather than on egtabllshlng the superiority of one system over 
another in the Mnner of an agricultural field fcxperiaanc or a 
harse race,"- 



^Robert Rlppey (ed.) Studies in Tranaactlonal Evaluation (Berkley. Callfor 
niatHeCuteh^on Publishing Co*, 1973) p» 

Walberg, ''Tranaactional Evaluation in Frrfesslonal Education," in 
Mppey^s Studies in Transactio nal Evaluation, o. l£7,^ 
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in view of the findings generated from other urban teacher training pro- . 

jects based on the soclo-cultural model. It was found that traditional educa- 
tional researeh and evaluation techniques were not appropriate for a predomi- 
nwicly' black""t:eacher and coominity clientele.^ The traneactlonal evaluation 
model adopted by the program focused on program processes, transactions among 
program participants, critical events and program history as well as the unique 
characteristics of the school setting. Naturalistic observation, key Inform- 
ant Interviews, post meeting reaction sheets and cataloging of Informal inter- 
actions among particlpanti and staff were among the first data collection 
techniques to be used in an atten^t . to obtain a status description of the sys- 
tem and the initial changes attendant to the introduction of the Teacher Corps 
curriculum. Later, survey, psychological, and performance measures of program 
participants and their clients, the. students, were introduced. A comprehen- 
sive needs assessment of the school/community was undert^en once staff had 
the trust of the participants in the program. The transactional model allows 
renegotiation of the data collection methods with partlcipaiits on the basis of 
feedback and this procedure occured twice In the first year of operation. 
Student data collection procedures were renegotiated in the fall and cadre 
data collection procedures were revised at the end of the first semester of 
operation. Further, on the basis of feedback and analysis of data, the pro- 
gram was able to self correct and change mechanisms for participation. The 
transactional approach recognizes many audiences for an evaluation from people 



%. Schwartz, "An Es^erlment in Training Taachers^.for Inner-City Schools 

g^^^^j^^ Systems-Approach-in-the-Ford-Trainlng-andiPlacement Program, "1. North 

Central Association Quarterly (Vol. XLVI:4, Spring, 1972, pp. 376.^380). See 
also for exan^le: Barbara Biber, Elizabeth Gllkeson, and Charlotte Wmsor, 
B asic Approaches to Mental Health; Teacher Education at Bank Street. New York: 
Bank Street College of Education, 1966 1 Dan W. Anersen and John M. Antes, 
"Micro -Teaching for Preparing Teachers of Culturally Diverse Children, The El- 
ementary ' School Journal ,IXXII, No. 3 (December 1971) pp. 142-49 f Robert F. _Peck 
■ - . and Oliver H. Brown, " The R and D Center for Teacher Education, Journal of Re - 

^ ':\ aearch and Development in Education , VII, No. 4 (Summer. 1958). _ 



being evaiuated to readars. of evaluation reports^ each with disparate QOncems 
and values. It attan^ts to deseriba and aBsasg tha program and to predict be- 
havior In explicit reference to tha various publico Involved In the program. 
The Implementation of the model requlras staff roles at the Intarface o£^ agen- 
cies, parity among the various participants^ individual or agency^ and nag ot la 
tion as the proceas of arriving at a total evaluation design. The approach is 
particularly uieful In progrMs with only originally defined intents | where 
tha participants specify the goals and tasks they wish to accomplish within , 
the framework of improved, teacher and student per foraance. The approach is 
co^atible with programs in the davalppmental stages and in multiple purpose 
programs because it is flexible and rasponslva to shifts In conditions , needs 
and values. 

y However 5 the transactional models In seeking co^rahenslvanese and under- 
standing, sacriflcas some of the objectivity axiA precisibn of measuremants of 
the experimental research model. Further, in raalntalnlng its relativlstic 
flavor^ the modal losas soma of -its authority. In an attempt to compensate 
for these features of the model, the research team for the project built in 
features of the classical psychometric pre and post test model and the eval- 
uation by objectivas framework of Tyler and the co^arative components model 
for insarvice teacher aducation proposed by Joyce and Howey, Thm wholistlc ap 
proach to the projact Is provided by the historical record; the managerial 
analysis method provides Information concerning staff activities , and many of 
^Ithe synthesis techniques are borrowad from anthropology in order to organize 

and raport results. ^ ~ 

With raspact to ^tradltion^ the first research methodology presented is th 
classical psychometric analysis ♦ . 



II,.. Ouantltattva Method 

Spanning all of the evaluation methods utilized are a core of generally 
stated prlnelples of operation \rfileh structure and organize an evaluation to- : 
wards the satisfaction of stated goals. Within a specific method, certain of 
the principles are stressed^ receiving most emphasis as" a result ^f the unique-^ 
characteristics of the more specific modal . One of the primary purposes of the 
Teacher Corps project which the quantitative method fulfills is that of provld- 
"lag feedback to program participants and managers that ^s useful in attaining 
a status picture of goal accomplishment * bM one that^provldes Information 
which will allow adjustments to be made in the program enablij^ a more complete 
satisfaction of the: stated, goals* The quantitative method^ as the labeL^^^l^^ 
involves numerical information^ and it la primarily this aspect which separates, 
this method from the others. Within these purposes and coincident with the nu- 
merical emphasis, certain principles of operation are emphasized for the quanti- 
tative method, and the education of these will clarify the (Intents, activities 
and expectations of this kind of evaluation. 

A. GuldinE Principles _^ 

The quantitative method will make use of formatlve and su^ative evalua- 
tion. In accordance with the transactional models data: collected will be pre- 
sented to participants and program managers either in iumiari^ed or in inter- 
preted form^ and data^ and results wlll.be retained for possible future use, , 
Wherever possible, data will be collected. at logical times related to the pro- 
gram a true ture^ but with a sensitivity to not overrirtielsing participants or 
burdening program personnel with questionnaires, forms , or other evaluative 
tasks which may deter the nomal functioning and progress of the program acti- 
vities. Consideration must always be given to "giving- bad;" something in re- 
turn for what is taken in the way of dataj time, or„ sewices^^a feedback to 



pafticlpants will most often tak^ the form of avaluatlve summarlas of data whieh 
are gathered* Reeords will be kept to stand as %ard'r avidenGe of auceea 
failures, of strengthe and waaknessee, and will comprisa and faQilitate documen-' 
tation of proJaGt activities for dissemination to the educational and public 
sectors. Such data will further developments of the^program model-in-^^ 
retical and practical terms in the time after the program has formally ended. 

A procedure utilized in most types of evaluationp but for which the quantt- 
tative method is particularly useful^ is that of needs assessment. Within a 
transactional framework^ participants L desires and needs form ^a major struc- 
turing component for curricular programs offered* As such they require evi- 
dence of need which can not only be clearly portrayed,^ but which 'is ' in a form, 
that can be easily summarized, statistically treated^ and probed for deeper 
interpretation* Any determination of the satisfaction of goals which is under 
pinned and formulated within the framework of participant needs is facilitated 
by evidence in the form of quantitative data. The specific curricular goals 
for the project rely upon the meshing of theconeeptions and resources held by 
the university faculty with the perceived needs of the participants. The lat- _ _ 
ter cannot be articulated at the beginning of the project, but evolves Instead 
during Its operation as a result of the interaction of university faculty with 
the teachers and the community* Specific goals -may change as a result of uni- 
versity Intervention in the school. Continuous needs assessmentj^ thferef ore, 
contributes to the evaluation- process by defining and re-defining the goals to 
be evaluated * goals which are not (and possibly cannot) He specified before th^ 
program begins as is the conventional mode of program eyaluation. Prior assess- 
ment and continual re=assess^nt of need are thus a most important aspect of 
program evaluation to which the quantitative method of evaluation; is well ap- 
plied. ■•" 



^ ^^.-^^i::'^^^: ln many raspeets the previous suramary of principles preeenta a general - 
statement of the more specific objectives of this method* Because this docu- 
ment ig foeuaed upon curriculum^ and more specif icallyj in-aervice within the 
project, the specif ie objectives will be stated for. clarification of this em- 
phasia and the limitation of ecdpe imposed by ^ thls^foctis. 

/I) To assess the degree to which the ©bjectivea of in-service programs 
were accomplished* ^ 

2) To identify the strengths and weakne'Sses of in-service programs* 

3) To assess project progress with respe«^c ta la^servlce both during 

/ . and at the conclusion of each in-service segment -and to facilitate i 
self correction of activities and methods where needed, 

4) To locate areas needing further development and training with 
respect to in-service. 

5) To provide feedback to persons for whom the in-service is given and. 
■J' to those peripherally affected by the in-service* ^ ^ \ ^ 

6) To facilitate replication* of those successful programs of in-service 
^ and dissemination of prograia Information to a local and national 

audience. :. . ^ " - 

To this date, the above objectives have guided decisions concerning the 
type of data to be gr.theredp when it was to be gathered^ how It WQuld be fed 
back to participants and the larger audiences, and the extent and type of docu 
mentation i^lch would be produced. The following section spells out the parr 
tieular applications of the quantitative method for the various sagments of in 
service programs ^ many of which are now in progress* 

C. Applications of the Quantitative Method 

For the purposes of this report, the applications of the quantitative 
method will be confined to those aspects of the program related to the develop 
men t and Implementation of curricular activities. The earlier description of 
the ^n-service program points out the various facets of the program for which 



a curriculum was devaropied, m6 In all casesj an assessment of partieipant 
needs was a'- major' 4-'ilding cDnnipoiien.t. Because partiGlpant needs influence to 
a large extent decisions concerning curriculum, the needs asgesfiment activi- 
ties ^hlah were cDaducted will be discussed initially followed by a descrip- 
tion of the formative, suromatiHre, and pre-^poBtappllcatl.Qns^ 

D* Needs Assessment 

Participating In the project are university staff, elementary school per- 
sonnel and the community of parents served by the three involved achoola. In 
this first year of the projectj most activities were to be focused at: Hln ton 
Elementary School with gradual Inclusion of the other two schools, Banneker 
Elementary School and the Parker Child Parent Center* It was the Interttion of 
the nee4a assessment to determine what participants desired and needed, and to 
deliver upon those needs utilising the resources with available staff or out- 
side conaultantir. Teacher Corps National luidellnes required that the first ■ 
sIk months of the project be spent In a comprehensive needs assessment, the 1 
Information to be utilliied as early as possible for the purposes of structuring 
and planning in-sarvlce for teachers. Simultaneously with the needs assessment 
activities^ a program was to be conducted ^ and for thlm reaeon, a siiialler scale 
needs assessment was conducted,i; .In May and Junes 1976 the projected partici- 
pants from Hlnton Elementary School ware asked what they rseeded In the way of 
training J equipments curriculum materials and services. Based upon a summary 
of these responses and other more informal and less quantitative assessments ^ 
the Sxjmmer Training Workshop ^as planned. Additional information gathered in 
the first weeks of the project sufficed as planning information throughout the 
summer, and by continual small scale re-assessment of participant needs this 
information was added to and altered. Such activity was to sustain the project 



while tha larger naads aseessmant oeeupiad the first months of the project opera *^ - 

The larger needs asaessment utilised a packaged program published by Fhi 
Delta Kappan^. ^e package consists of 18 predetemliied aduQational goals ^ to be 
rank ordered by participants in order of eaeh goal's relative importances After , 
the ranking procedure, participants respond to the goals with their opinions as 
CD how well the school^ JL a achlevl ng^^heae goals^ By these two procesB-gs, those 
goals which are most Important and also not being accomplished are Ideritlf led. 
Participants then discuss these identified goals and record the problenLs and 
cauaes associated with the lack of goal accomplishment. The information. obtained 
from the process not only specifies the highest priority needs, but Includes sug-y 
gestlong for causes and in this way etnietures future attempts to better satisfy- 
these goals. 

For the present project^ the teachers of Hinton School and a volunteer group 
of approximately 25 parents completed^ this process (separately) over tha period 
from October, 1976 through February, 1977. During this same tl^, a descriptive 
profile of the Hinton student body was prepared consisting of attitude and a- : 
chlevement data in reading and mathematics. Once this total Information package ^ 
was collected and summarised,- it was fed back to Hinton personnel and parents. 
As a culminating activity, one that is Inteded to produes the most useful inf or- 

. . .. . - ... - . . . ............. ..^ ....... .. 

mation for planning future in-service, teachers will respond to the Generic Skills ^ 
Inventory^j ^n instrument designed to- enable teachars to ^specify those areas of 
teaching for which they feel well prepared and not well prepared* The needs 

^Needs Assessment materials available from Phi Delta Kappa, Eight and Unions 
Box 789, Bloomlngton, Indiana 47401, 

-James, Barry N. , Teacher Education Projects Florida State University, College 
of Education, TaHahasee, Elorida 32306. 
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aeaessmant iriformatton fad bae^ to teachars will help them to locata araas of 
greatest need for devalopment* Hopefully, teachers will- see the need of further 
training in these areas* 

Much of the quantitative data from the needs assessment will prove useful 
not only to in-service planning of currleulum^ but wiir be helpful in Aooklng 
back on the in-service activities which have already taken place. Comparing 
more present needs' eicpreasad in the larger— asses amen t^wlth those needs outlined 
in thii preliminary needs assessment before project activities began may give 
:sD»^e indieatipn of ~ the degree to which certain aspects have . been addressed or 
a^ife still of major concern. In particular^ 'the topics of Metrics and Diagnos- 
tic Prescriptive Teaching, which have been the subject of a considerable amount 
of study for the Hlnton faculty^ may be viewed differently now by participants 
than before the project began. Other uses of the quantitative data from the 
needs assessment will be trfcen up later in discussion of psychooietrics In the 
pre-post treatment design, 

E. Formative Evaluation ; 

Up until the present timej a variety of formative evaluation techniques 

have been utilized with in-service activities. For the summer program^ post 
meeting reaction sheets following each session were the primary formative in- 
strtmients utilized, and results ware fed back weekly to participants* 

A common core of questions were asked after each session concerning the 
utility of the session in imparting new informations in providing occupation 
related Inforioation^ in providing opportunity for questions and; discussion and 
the like. Two or three additional questions were asked each week (or for par- 
ticular sessions) relating to the content of the topic covered and its relevance 
to perceived needs. Following each session, those staff members who presented 
Information and who were planning the next sessions reviewed the reactions pf 



partlcipantSs and quite often altared original plans for future sessions baaed . - 
upon these results. EKamplas of the use of these documente can be found in --A ^ 
Description and Evaluation of the Hinton School Summer Training Programs July, 
1975."- 

During the fall of 1976, a morning in^-sarviee program was begun^ offered 
three times weekly for the entire Hinton faculty, and participants 'reactions 
to the sessions were sampled less frequently than for the summer. Because the 
needs aaaeaament activities occupied many of the September morning sessions, 
the in-service program was not operational until October* In the first week in 
November, teachers were asked to fill out a rather detailed list of questions 
concerning the manner and approprieteness of the format of in-service sessions 
and of the usefulness of the various topics which were covered. Within two 
weeks of filling out these forms, a suEmnary of these data was passed back to 
participants-and jdiscussed* The data plus reactions to it were utiliMd for 
planning the remaining sessions inthe first semester and for projecting the 
type of format and subjects to include for the 1977 semester, , 

Morning in-service sessions for the 1977 semester did not formally begin 
until late January, and an evaluation of these sessions has as yet not been ^ 
taken. Based upon the results of evaluations of the fall programs ^^the format 
was changed from a large group format to a small group, from mandatory to volun- 
tary sessions, and was to focus more upon in-class types of activities for teach^ 
era. Participants- reactions to these changes and to the value of the in-service 
now being offered will be obtained at the end of February ^ and the instrument utl 
llzed will be of similar nature to that used in the fall. 

^Cichons Dp J, j Olson, G* E., Schwartz, H, S*, *'A Description rad Evaluation 
of the Hinton School Sumner Training Program: ' July 1976,'* Roosevalt University ^ 
Teacher Corps Project - Cycle 11, Roosevelt University, College of Education, 
Res ear and Development Center- . - 



:oriivn.<j.orife' addltlorikl 'and Irtpbrtartt -place of fbrmativ© inf ornrftiodigathferad vfer. / 
j : all In-aervice programs wae attendanca records* Although the ^eesionac^ara^^q = 
tMhrtifcal4y^^hdatotfy^^fDr^-teac^^ soon-teeaM' e^^idene^^^hat?*©^ ex- 

V^'^^^^s^'d* t^Mt^^vl^e^ utilllty rof\^h© laaBSlohs /b.y ^tt^iEmetm 

■ iQi? WStetitftf. -A^ttitttfantda^ riaordrf ^^ttpreiented ^k' useful tirfdia^^ 

As outlined earlier In the report^ members of the Hinton achool/conimunity 
(facultyj admlnla tra tors s and parents) were invited to partieipate In the Hin*- 
ton Cadre ^ to meet for three hours on Wednesday afternoons for the express 

purpose of analyzing the various school roles ^ improving communication between 

r B':3unqi:2l:}^€-q iln Oj ki*'fi^:^-^}{*h:ih^i n^^w mirj?fOTq /^arrrK^?^ ti'3jr?n5> sriJ goi^ 

the persons at Hinton^ and identifying and working to £olve some of the major 
problems-confronting Hinton School* Because the format was collaborative in 
aature and discussion-oriented by design, formative evaluation activities took 
the form of attendance data only* Informal discussion with participants by 
the Teacher Corps staff "both during and outside of these meetings sufficed to 

indicate Che interest levels source of discontentment if present, and success 

-aifu,^--t.- tUa^^n xi^-r.Xsnzf^r-.'i ^.d- ■ j : r^r:;i v't.^ r-^v fnici/^.n ^i^ln eJcb ^^ecifM 

of the program generally* These took the place of any- formal process as evi- -^l ' 
danced in other in-service segments* 

In addition to the Wednesday Cadre meetingSp formal classes were held in 
Administration and Supervision and in Language Arts for those faculty and com- 
muni ty members who desired them* Again* the only formative evaluation'^iEplpyed, 
other than the formal requirements of assignments given by the instructors 3 were 
in the form of attendance reports* These courses were university credited 
courses offered in the field for those participants from the three schools who 
::jranted university or lane placement credit for this additional academic work* 
These courses were not directly related to problem solving or role clarification 



as waa tha^Wadnesday session,: ^andrwer^ ^somawhat ^dJunatvCo jthe tCoC^l In^sarvlee 
program.^ -^^T' -"^f. .1 . \ . -.^ - n-.n ,.-.7-^/- 

:> These then represent than forma tlve _evalua£loa ztachniqMf s. <eaiployad up to ^ 
the present tima whieh Involve quantitative datSf and a brief sunipnaryi ©f their 
results iwlll be pretented <ln a subsequentv ppr,tl€nrf£ this, report* In general * 
the methods have proved quite useful. an^^lUbe retained as tmethods for self-' 
eorrectlon and continuous partlolpan^^^^adback^for: ^future ;ln*aervlce €f f oE.tsv: 



V F. Sun™«tlve Evaluation 

For each of the segments of In-servlce^ there was some form of summatlve 
evaluation* On the final day of the summer workshops , an evaluation question*^ 
naire covering the entire smomer progrw was administered to all partleipants' 
present* Topics covered in the in-service were rated in five categories s new 
knowledges interest, usefulness for professional work^ quality of presentation, 
and desire for follow-up. The results have been utilised to determine to what 
degree objectives for the workshop were satisfied and in making future plans 
for the upcoming 1977 summer workshops to involve both new and old participants. 
These data also helped verify the extent to which the preliminary needs assess- 
ment data were operational, and in this way provided valuable input for planning 
in-service programs taking place during the school year. 

Summative information for the Wednesday Cadre segment (concluding its first 
semeiter of activities in mid-Januaryj 1977) constituted attendance data, yrfedes 
obtained, products of the participants, and evaluation of faculty ins true tlonite^ 
All these data in some way indicated the success or failure in achieving Cadre 
objectives and were reviewed extensively by staff involved in planning the sub- 
sequent Cadre meetings for the second semester. The results of portions of this 
summative data will be reported in a-subsequent section of this report. 

As stated earlier, evaluation of the morning in-service sessions consti- 



CuCed for the most part periodic aseessments by participants , and summi»tlve eval" 
uatlon.up to this point has involved only Che cc^tent of Cha sassioni. Iti the, 
' case of tha fall morning 1^^ cognitive taata on Metrles and Diagnostic 

Prascrlptiva Teaching were admlnietered. These were given to determine the sic- 
cess of the aesaiona in Imparting a given body of knowledge and werej f©r purpa- 
ses of planning further in-aervlcej largely with respect to decisions whether or 
not more instruction was needed or If a naw topic of Instruction was advisable* 
Summative information for the fortnil classes offered in the field took tha 
form of final examinations and papers required of the participants. These ra- 
quiremants, when imposed, ^^wara the responsibllity-of-rthe=^Etaf f^^embers conduct- 
ing the courses, and were for the primary purpose of %yalua ting learning of 
participants .p ^ 

For the moat part, these summative data served, the purpose of enabling a 
da termination to be made of the overall success of the In-eervlce, the extent 
to which statieS^ and unstated objactives ware accomplished, providing a 

record of end products for whatever future function they might fulfill. In 
keeping with the purposes of tha quantitative method, these data in'nt^erical 
form represent avidenca of past efforts and what these efforts yielded, 

Psvchometrica: Evaluation Involving Pre-Post Design 
The satisfaccion of the major goals of the project and answers to the 
ultimate question: What impact will have been made by the advent of this Teacher 
Corps projact on the participants? will depend upon some tnaasure of change in 
the participants themselvas. The type of information which can report changaover 
tline Is that which is longitudinal and which measures In some mannar the situation 
prior to any major project Influence as wall as during and after the project's 
existance. The simplest form of this data gathering procedure is the pre-post 
evaluation design, and for the above stated reasons ^ certain of ; these measures: 



up until this time have been taken for the pre- test phase only. The fQllowing 
will report the ststus of pra-post evaluation efforts and will apell out future ■ 
intentions in this regard, ^ 

In th*s first year of the project, pre-post evaluation has been restricted 
to the Hlnton community, broadly defined as Htnton taacherSj adtainietrstors ^ 
role specislistgy coomunlty meoibers, and students* With respect to scudents, a- 
chievement test scores taken in Hayi 1976 in mathematics and reading and student 
attitude measures constitute the pre^teit information which has been gathered^ 
Achievement scores are from the IOWA Test of Basic Skills , and attitude measures 
are from the Self Observation Scale, both of which are used by the Chicago Board 
of Education for citywlde testing. These tests will be administered again in 
May or September for Hlnton students, and results will be analyzed, in terms of 
identifying what changes in attitudes and achievement >have occured among students 
which may be in some way associated with project activities. 

In the summer workshop sessionSj parts of the early sessions were taken up 
with the administering of attitude instruments to teachers (the Galifornia F 
Scale, the Gough-Stanford Scale of Flexibility, the Dogmatism Scale^ and the 
Measure of Social Distance based upon a semantic differential format,)^ These - 
Instruments will be administered again in June, 1977 after one. year's operation 
of the project at Hlnton/ At the beginning of the second week of the sumer work- 
shop sessions, a cognitive test was administered to teachers c^pverlng topics which 
w^re identified as needing study by the preliminary needs assessment conducted in 
June of 1976 and concerning topics which were prbjeeted for the curriculum of in* 
service for the coming year* This test^ again will be administered in June ^ 1977 
along wTth the attitudes instruments. 

^Shaw, M. and Wright, J, « Scales for the Measurement of Attitudes (New Yorki;- 
McGraw Hill, 1967). . 



Probably the largeit sec of data from the community vfaleh reflects the at- 
titudes and desires of parents Is found In the needs asfieassient^data deserlbad 
earlier^ both In the form of results from a email group of parents representing 
all three schools to the larger sample of data collected via a mailed out quei- 
tlonnalre to all parents. In that moat of these data were collected before any 
major activlcles with parents were begun^ parents- views are reflective of their 
opinions and beliefs towards the school and education in general prior to the 
project's existence* Though plans are not finalised at this tlmej efforts will 
be made to again saz^le parenta' views concerning educational needs of children 
this coming summer. 

It is noted in summary that some form of pre and post ddta analysis la in*- 
tended for each of the participacing groups? Hintonpersonnel, teacher Interns^ 
and community meters « Additionally ^ attitude data was collected for staff 
meters and irtll be analysed for changes that may have taken place. Once the - 
post testing is completed after one year of operatlonj the results will be ana^ 
lyzed both to identify what changes took place within and across groups, and 
to view these changes within the framework of the major goals and intentions 
for participants as stated In the original proposal. These data will be orga- 
nized into a summative report of one year's efforts and will be utilised exten^ 
sively for planning the anticipated second year of operation* True to the trans-* 
actional models such analysis and change in program format and offerings has been 
taking place all along, and it is possible that suimative assessment will merely 
mirror or suggest changes which are already in the making* If this occurs ^ it 
will only confirm the validity of the formative assessments. It is anticipated, 
however, that more will be revealed in the summative assessments and pre and 
post comparisons than could be obtained from the formativa assessments alone- 
Data concerning attitudes are not strictly included ir. the formative assessments. 



and the formative assessmenti by their nature are inGrementai in their daicrlp- 
tion. They may fall to point put changei which appear mlnpr or non-exli tent 
over the short range of tlrae, but add up to something more laa J or when viewed . 
over a greater time period* For these reaBons, it is strongly believed that 
all of the above types of quantitative evaluation are needed. They are methods 
which win dataV data ffiSt^ W M 

gathered and ii representative of the time in which it was taken. 
H, Summary of Reeultg of Quantitative Evaluation 

Certain of the in-service segments have been oompleted^ such as the Summer 
Workihop In-service Program and the first semester Cadre session, and formative 
and aummative results are available* Other in-service programs are ongoing for 
which summativc data are not available. Additionally, the pre-post design for 
certain aspects of the in-service curriculum are as yet incomplete and prelimi- 
nary InforMt ion is the only data available at this time. The discussion of 
results for the purposes of this report will be brief and will provide examples 
only ways in which quantitative data was and is being utilised to eval- 

uate the various facets of In-service In the project^ More lengthy treatment 
concerning the total in-service will appear in a monograph already under prep- 
aration reporting the first year's progress to be distributed at the end of ^hIb 
summer.. . p^v' ■ 

I» Bummer Workshop 

The formative data collected dally and sunMaarlzed for participants weff Vy 
consisted primarily of ratings from 1 to 5 ("not useful" to "extremely usafiul") 
of the manner of presentations and the topics discussed i It was mainly used: for 
deciding what content r -eded bolstering or added review and deciding which format 
of preeentation (small group discussion* lecture, etc.) was the most stimulating 



"25- 



to the group. The sumraative instrument given on the last day of the iunmer work- 
shop was similar In format and content of the formative post-meeting reactipn 
sheets s and the summattve data collected In almost every case supported the for- 
mative findings. For this reason^ the summative highlights will be presented 
and it can be aaaumed that these reflect formative ratings as well. ' 

On the auMaative questionnaire, respondents rated the topics In five cate- 
gories: new knowledge, interest, usefulness for professional work, quality of = 
presentation, and desire for follow-up. Ratings were from '1' to '5' , lowest 
to highest In the respective categories^ and according to the criteria stated^ 
ratings were uniformly high, all averaging above '4' on the 5 point scale. The 
weekly themes of cross-role training and individual curricular topics were con- 
sistently viewed by participants as the most interesting and useful for profes- 
sional work. The curriculum topics of Metrics education and the EKceptlonal 
Child were Identified as areas in which participants desired most follow-up. 
Viewing the evaluation ratings by specific daily topics i there was a very close 
relationship between the ratings of new. knowledge and intarests, and to a lesser^ 
extent^ the quality of presentation. These are examples, then, of the. more macro 
findings emerging from the quantitative evaluation of the suraaer program. 

J. Morning In-Service 

The quantitative data collected for the morning in-service sessions were of 
three types: pre-post cognltlva evaluation of content areas covered, evaluations ■ 
of participants* assessments of the appropriateness of the format and contentp 
and attendance data. Cognitive pre-tests given in October, 1976 on Metrics and 
DiagnQStlc Prescriptive Teaching revealed that factual knowledge In these two 
areas were nor high among the participants. By mid-Deceirijer^ when the post-tests 
were given, the extent of factual .knowledge in Metrics had increased significantly,; 

28 
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Of the 36 persons taking the 15 item metricg pre-test, approximately 40% of those 
taking the test missed 10 or more items, and over half of those t^ing it missed 
8 or more* On the post-teatj sis of the 26 persona missed 5 or mora of the ques- 
tions, and the rest obtained a score of 70% correct or better. Four participants 
received a perfect score on the post-test. 

For the topic of. Diagnostic Prescriptive Teaching, it was concluded that the 
quantitative representations of the scores did not accurately portray the slgni* 
f leant learning that occured. Most answers requested were in narrative form, 
answers were often based upon past experience and opinion, and often there was 
not Just one cMrect answer for the questions* This Is an example where quantlta^ 
tive method was not the most appropriate as it was applied, and thus , results are 
incomplete without some consideration of the subjective judgements of the person 
who presented the material. Quantitatively, the gains were from almost no knowl- 
edge (very few questions being attempted) to much knowledge (almost all questions 
attempted). The nunfcer of questions answered indicate an increase in the amount 
of learning, but do not specify the nature of the learning, a more significant 
aspect in this Instance, 

Based upon these increases, it is concluded that some success was obtained 
tcith this approach to in-service, though cognitive gains were not as high as in- 
tended* A breakdown fay item of the test given and the identification of aspects 
answered Incorrectly has already given some Indication of where deficiencies may 
be found in the transmittal of this Information, Additional reasons can be 
found in other types of data such as attendance and participant reaction to the 
format and content* 

Attendance data did reveal Important information in this instance showing 
that attendance became IncreaslK^ly sporadic at the morning in-service sessions 
with the percentage dropping from nearly 90% attendance for the month of October 



to an average of 66% for the month of Dete^er* It appears obvious that absence 
was a major factor hindering learning* 

The results of the November 9th administration of the formative evaluation 
instrument for morning in-service provided additional reasons. For Itetrics only 
52% of the participants felt they learned anything nsw, and only 48% felt it was 
useful for their profasslonal role* However^ 74% felt they needed more in-service 
in metrics 4 and none of the participants stated that they were confident in their 
ability to teach the Metric system to the students. It appears that the sessions 
were not giving teachers what they needed in order to teach metrical and this 
would suggest one reason why Interest and perhaps attendance might have been low* 
With relation to Diagnostic Preacrlptlve Teaching^ a similar picture emerged. 
Though stimulating participants more than Ito tries ^ only 36% of participants found 
the sessions useful in their professional role, 87% said they needed mDre train- 
ing, and only 32% of the participants felt more able to employ Diagnostic Preserip 
tlve techniques in their teaching* :^ 

As a direct result of this combination of data ^ morning In-service sessions 
were changed considerably. They were made voluntary^ were changed to a small 
group format, and were focused on providing activities end individual staff demon- 
strations and assistance in the classroom. Though only the quantitative data has 
been discussed abovej this discussion providea an example of how such information, 
was utilized to diagnose problems connected with non-achievement of cognitive 
learning goals and how correcti.ons were made in the in-service activities based 
upon evaluation of participants' reactions, 

K, Wednesday Cadre In-Service 

Of quite different nature from the morning in-service were the Wednesday In- 
service sessions of the Hlnton Cadre, They met afternoons for three hours, were 



voluntary and offered for course credit, and the group was i mailer , 23 at masi- 
mum. Because of the discussion-orientation of the sessions, it was decided that 
quantitative forrantive evaluation was not crucial, and participants' reactiona 
throughout the semester were =gatheM informally by staff conducting the in- 
service and a noR participant observer at each session doing naturalistic obser- 
vations. Attendance data and a semester evaluation of faculty instruction by 
participants were the primary vehicles for snrnmatlve evaluation. Attendance 
waa good for the entire semester averaging 90% overall for the sessions. There 
was some attrition early in the semester with the nuH^er of participants drop- 
ping from 23 to stabilise at 19, \ Problems that arose during the semester were 
dealt with by the staff cpllectlvelyr No quantitative record of these problems 
was taken, though ethnographic reoorda were made, 

Summative results of participants* evaluation of faculty instruction re^ 
vealed their opinions concerning areas of strength and weakness in the presen- 
tations. Participants rated twenty six diiferent characteristics of the cadre 
in-service program on a 1 to 5 scale* nui3]ber 5 indicating the highest rating 
possible. Highly rated by participants were mastery of subject matter by those 
presenting material, opportunity for discussion, and the inforaatlveneas of the 
discussions that took place. These raceived an average rating of 4*4, Lower 
rated were productiveness of aislgnments, freedom to eKpress opinions, and or ^ 
ganlzation of the in-service activities * and these received an average rating 
of 3,4, The average rating for all 26 characteristics was 3*87, As indicators 
of areas to Improve upon, these quantitative data proved useful for planning 
the second Cadre In-servlce which Is presently in session* Some eKamples o£ ^ 
changes that were made for the second session are that activities are planned 
more collaboratively with participants, and the sessions have a greater concrete 
school task orientation than In the first semester, : 7"^^^.: ; 



The intentiou of the presentation of this brief overview of lome of the 
quantitative results of avaluation of in-service programa has been to demonstrate 
^ays in which such information ie being used to measure progress and aceomplish* 
Dflent ot complated programs, to plan and modify ongoing programap and to make 
judgements concerning future in-service that will be offered g Only a portion 
of the data has been presented ^ and only, some of the ways these data emu be uti- 
lised to obtain information concerning the in-service have been discussed. As 
stated earlier, most of the analysis of such data will be taking place In the 
near future for preparation of a su^ of the year report to Include 

formative^ summatlve, and pre-post treatment results* To be included In these 
analyses are correlational techniques applied Co particular questions concerning 
how best to locate strengthT oF^ what has he|n,,t^^^^ft^the p^^^to identify ui^- 
Intended learnings and unprotected assoclatio^^^^pl^to assess the extent to 
which stated objectives have been aceomplisVced #nd what the accomplishment or 
non-accompllshmant can possibly be attributed to» 

One additional purpose has beenp therefore^ to describe processes yet to 
take place and portray how the gathering of data which can be quantified can 
answer some important questions for the operation of a project such as this. It; 
should be pointed out that yet to be interpreted are the data from the needs me- 
sessraant conducted over the past 8 months. It Is anticipated that thasa data 
will better enable the structuring of the content of future In-Bervlce 'program 
yet to come. 

L. Limitations of the Quantitative Method . 

Everything that occurs in a project is not easily quantified, and though 
it may be possible to represent numerically a great deal of information concern- 
'ing project eventaV ^orae reductionism is always the result. ^ From the reduction-' 



iia cDmea a loii of flavor, of ptrspectivaj and of wpfds to si^resi Intelligently 
what "really" occured. All data are not reduced to nuodjers, therefore^ only 
thosa things for which it is convenlant, expedient, and useful^ As a consequence, 
quantification is limiting not only by the reductionlsm, but also by th% aKculslon 
of potentially revealing data* 

An additional limitation for the application of the quantitative method for 
this project is In the use of self-report data from participants. In that parti- 
cipants are taking part In the decisions that are madej their oplnlbns and view- 
points must be e^reased and documented. The most comon method of recording 
this Information is to ask them their Qpinion utilising soma form of Instrument! 
In the case of this project, reaction sheets, both periodic and summatlve* With 
such techniques, there is the assumption that participants understand the intent 
of the questions and interpret them In the proper manners that they answer them 
thoughtfully and stra that their answers are Ihterpre table - 

that Is - that they are Interpreted to mean what they were Intended to mean^ 
This leaves a rather large margin for error In Interpretation , and thus limits 
the dependability of the data unleas they are validated In someway. Though 
this applies to all self-report data, It Is particularly a danger If represented 
numerically * By translating data Into numbers^ one Interpretation has already 
been made, and those who read and Interpret the numbers can easily lose sight of 
the prior aisumptlons concerning vaUdlty of the data. The data are often in- 
terpreted more factually than la warranted, — 

One final limitation which may be more characteristic of this particular 
project than otherB is the ' fact that this project Is operating within a 
tranaactlonal framework, that goals are reformulated and added, and along 
with such flexibility, the aspects which are measured change also. With the 



use of fjuantitative methods , In particular pre-post methods and correlational 
analysei^ it Is desireable to designate what will be quantified and when it will 
be quantified before the Initial activities to be evaluated begin. Within the 
tranaaGtlonal framework^ it ii impoi^ilble to foresee all aspects \^lch will need 
to be evaluated j and thus the scope of evaluation that is possible by quantita- 
tive methods Is limited. Included with this limitation also are the problems of 
any study that is lon^ltudinali that of sample alee itself and the possibility 
of change in the original sample. For any statistical analyaii of data which 
have been quantified, these inevitable occurrences must be dealt with In some 
manner^ again limiting the amount of reliability and scope of Interpretation 
that is possible. 



Ill . . The Ethnographic Method Applied to Educatloiial Research and Evaluation 
A* Asiumptlons and Purppge 

The basia approaeh to ethnographic reaeaMh and evaluation comes from the 
discipline of anthropology. Anthropologlits concern chemselvee with habitual 
behaviorSp individual Md group, irfierl ted and learned* They study himan be* 
ings in institutional settings including the straina institutional settings 
place on individuals* They study culture, which is everything that man is and 
does,^ In this prograrai the ethnographic methodology will be used to document 
the development of culture of the school(s) in which the program operates, of 
the cadre subculture and of the evolution of the program's ethos. To accon^- 
llsb these tasks, anthropologists use special ways of looking at the world and 
its parts and techniques for investigating that part of human behavior to be 
studied. The specific approach being used here Is that of applied anthropolo- 
gy^^ . the selection and use of ethnographic data for dealing with 
educational problems. Applied ^ anthropologlaal studies can serve 
tos (I) raise an individual's cultural awareness , that is, what is it in one's 
beliefs, background' and social situation which md^es him act the way he does?| 
(2) help pinpoint the probable roots of cultural or subcultural conflict in a 
given situation^ (3) provide Information about the culture of a school, or a 
comoinltyj or a classroom. Such studies point up the similarities and differ- 
ences among group and individual behavior and allow one to look at a situation 
from a trolls tic point of view. 

^Melville J* Herskovits, Han and His Works (New Yorki Alfred H. Knopf, 
1949)* ■ ^ ; V 

^Leslie White, The Science of Culture (New Yorks Farrar, Strauss and Cuda- 
hy. Inc. 1949). 

%eorge D. Bplndler. Education and Culture » Anthropological Approaches 
fChlcagoi Holt, Rinehart and Winston, 1963) • 



The yarpomm of tislng ethnographic approaches to program evaluation is to 
documeiit the longitudinal dfevelopment of program themes, to reeord the respon- 
ees of various groups to the Inservice and preservlce currlcul™, to trace the 
evolution of the cadre subcultural ays terns , and to describe the ethos of the 
prograni, rate program will provide a rich background for the data reeultlng- ^ 
from the other methodologies. Further^ the ethnography which results from the 
two year invsstigat Ion complements the cultural level of the sQclo--cultural 
mDdel underlying the progrMi, 

The conceptual approach borrOTed froDa anthropology is that of tha cultural 
unlversars framework,^ The Mthropologlst looks at schools as subcultures, at 
classroamV teacher groupings, or cadre groups as subsystems of the school 
culture* Schools, claesrooias and cadres like other systems of human behavior 
build cultures ^ich are coc^lese, probaballstlCj and self regulating. Also, 
like cultures, most schools, classrooms and cadres can be observed to have 
purposes, structures, functions, content, patterns and soma form of coherence* 
One can view schools, classrooms and cadres in terras of some commonly accepted 
anthropological constructs or unlvarsalSs These universal aspects of culture, 
classrooms, schools and cadres are created as the informed group meniflbers trans- 
mit knowledge to the neophytes, and as they toteract with the values,, skills. 
Information, and attitudes to be learned from the curriculum. The who 1 
process Is called education, a special form of the general procedure known as 

socialization* ■ • , -' ^.J!::! --- ;-- - — " 

' X program^ eight universal patterns have been identified 

/ ^M. Herskovlts, mn and His Works , pp. 227-440* 

— Schwartz and M* Jason, A Guidebook to Action Research for the Occupa- 

tional Educator (Springfield, Ilir Illinois Of^flce of Education, DAVTE, 19 
pp. 135-180. - - ^1" . 



for dscumentatlon* Each claiiroonij eehool, eonffittuhtty, cadre and culture has 
some way of handling these universal aapaets of behavior, but each culture or 
subculture dleplays a unique way of doing eo. For eKa^le, all cultures and 
subcultures have a value system which indicates what ought to be the preferred 
ways of doing things o believing irtiat la good and what is badi- All have a 
cosmology or world view which specifies what constitutes reality tn the school* 
the community^ the cadre or the classroom* Each cultural unit has some for m 
of social organization which governs individual and group relationships even 

to the point of determining forn^ of verbal address. Each system has a tech* 

; . - ' ' ■ ' . ' : .... ■■■ 

nology , a body of knowledge and skills used to perform the tasks necessary for 
the system to function and survive* There is an economic system which regu- 
lates the allocation of goods and services in the school i the cadre and the 
classroom. Further, there Is a form of gove rnance or a p olitical system regu- 
lating Individual and institutional behavior which specifies how decisions are 
made and who participates In what decisions/ TyplGallyt there la a special 
iMguaga uniquely suited to the educational proCMs or the subject matter of 
the classroom* Finally * there is a sQclalliatlon process or educati onal pro- 
cess which regularizes the transmission of knowledge to the neophytes, the un- 
learned ones in the group* It should be e^hasized that the cultural unlver- 
sals model is only one of many conceptual frameworks which anthropologists use 
to look at the world* 

Several principles of research in appiled anthropology nwst be-atated ini- 
tially* If one is going to do research with living cultures and real people^ 
the following guidelines should be obseryedi 

1* The Investigator must be aware of his otm biases and understand that 
he Is viewing others through his om cultural window no matter how ob 
; jective he tries to be. 



2* Tha investigator must be able to coaminlcate with the peeple whose 
cultural syitera he is studying ^ aither on a first-hand basil or 
through a key inf ort^it who has the respact and confidenee of the 
members of the group as well as an in-^depth knowledge of the cultur- 
al pattern under investigation* 

3. The investigator nttist be willing to spend time (typlQally at least 
a year) obsetvi^g at first hand the group under study either as a 

.4. The investigator cwst have aeeess to ^i^lttan reoords. If any, artl- 
faQts and other objeets produced by the group. 

Some oonsideration should be given to the kind of questions this form of 
investigation can answer and the kind Df problems best addressed by this tech 
nique of evaluation* Generally, anthropologiaalreseareh is qualita rather 
than quantitative. iSiis does not mo.an that ai^^hropologtsts never use nmibers 
or statlstloal teohniques. It does mean that mji^^ of che ^thnographiG liter* 
ature tends to be descriptive and Intarpr^tt^^'^lvfit fo^ the anthropologist pre- 
sents as cosplete a picture as possible at the culture of. a group* Therefore, 
if a problem can be resolv^id by an eKpfcrlmental or statistical design, using 
the anthropDlogical techniques would add additional insights and understandings 
concerning the behavior of persons in the system, bu. i^orld also be time con- 
suming. The advantages of one method of Investlgatluw o'^sr the pther were con* 
sidered before embarking on this method of evaluation. It was felt that there 
were some aspects of the program which did not yield to docnimentation by the 
other techniques already described* For aKample, how best could cadre partici- 
pation in program activities be documentad? How else could a complete picture 
be made of the Impact of the group on the SDniall^ation of the interns? Did the 
cadres have any influence on the direction aj' the inservice curriculum? 

In order to describe, explain and afi5%7 5' on^ or more of the universal pat- 

^; , -^^ "Kia Intansivf. Htudy Small Sample CoBBtunitiea" in R. 

Spencer -s (ed.V Mathod and Perspective i a AnthrcpoJo^y (MlnnaapollL^: Un varsity 
of Minnesota Press i 1954). 



tarns of culture mentioned earliar, the anthrepologlcal Investigator uses four 
baale techniquest abservatlotit Inte^lewt aolleetion and analyits of bitten 
documents or Other objectis and the eolleetlon and analysis of demographic data* 
These technlqueSp as used in the prograiQ evaluation^ are sunMrised below, 

B. The ^thodology ^ 
The four major data collection techniques used in this inveitigation are 
demographla analysis I observationp interviewp and ftinctional or content anal- 
ysis of written docuMntSp^ Other techniques may include surveys ^ life histo- 
ries, the eKminatlon of cul&jral objects or artifacts ^ the collection of tope- 
graphical and aocionietrlc data and the audiovisual recording of ceremonies and 
rituals. . - . , ■ 

1* Pemographic Data Collection 

All investigations should begin with inforiMtlon concerning the nature, of 
the population under Investigation - base line demographic Information^ vital 
statistics* Thm program staff collected dMographlc Informtloa concerning the 
three schools to be Involved in the program and the salient facts regarding the 
cofltaunlty In the development of the project proposal, InfoTOation concerning 
the potential participants* age, seKs ability levels attitudes , socio-economic 
> status, race, the location and description of the schoolsp floorplanSj time 
W schedules, students* educational levels, teachers' years of job eKperience and 

— ^ ... - . it \ - ■ . . . ■; . ■ . ■• ■ ■ .- ■ ■ - . . - . ■ ■ . ,,.7 , ,. _ \ ..■ _ , : ■ 

■ ■ ... ■ .- . - ■:■ .. ' _ r- ■ - • . 

V other information relevant to the group was collected before the program began ^ 
V:. and at its inception. Now spot checks are done periodically to see if the nature 
of the "population has changed in the schools, the coimnunityi the cadres. Demo- 
- g^^ is collected on those^variables which may influence par cicl- . 

more detailed description ot these techniques applied to schools can be 
..found in Estelle Fuchs, Teachers Talk (Garden City: New York: Doubleday & Co. 

%-.y-.::i;) lnc«, 1969). ; ' - 
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panCs' response to the Gurrlculum and may guide the development the culture of 
the progrM* 

2# Observationg 

Henry^ has olassified the types of observational technlquei -in the follow- 
ing manner. 

Naturallstic i The inveetigator is known to the group as an observer and 
engages in direct observation of persons and groups recording almost every- 
thing and letting patterns emerge from the data^ 

Structured ; The observer identifies the behavlprs he axpacte to be pre- 
sent in a iituatlon^ organizes them into sets and then records their presence 
■ - ^^...-...-.^j. . _ ■ ... . 

over a series of obseryations. For ejctfttple, the preservlca inteam should be eK 

pec ted to keep track of time spent on the Jobs 

Participant : ^ e Investigator la a number of the group being studied or 
has a role relationship to and frequent interactions with the persons being 
studied. 

Nonpar ticlpant : The observer is not a msD^er of the group and his role 
and/or preaenee may not be known to the group. 

All four types are being used to prepare the ethnography of the program* First, 
the Interna, the preservlce teachers, thrpugh the vehicle of dally logs are en- 
gaged in participant naturalistic observations the school culture at the 
Hinton SGhopl. Second, each cadre has a trained staff menier functioning In 
the role of nonpartlclpant observer m^lng naturallstla_observatlons In ten 
minute tlmed^ Inteivali, Tniird, other staff and faculty members are engaged in 
participant observations In classrooms In a, structured way* Finally, cadre 
members have been asked to record their reipbhses to various aspects of the 

^Jules Henry, collected manuscripts,; unpublished, est* date 1958. 



program and to share them with etaff memberi. Each of these aer.s of observa- 
tion notes will be analysed for patterns , for commonalities and uniquenesses 
and for critical episodes in the development of the culture of the program. 

In each instance, the observation record ipcludes information concerning 
the location of the event, the*7 time, the physical surroundings, the behavior 
of the people, groups and institutions involved In the situation and the role 
of the observer* Observations of the inservice and presp^rykce events in the 
curriculum are made on a regular basis over a one year period to aapture the 
full cycle of activities. Nonverbal actions, body language, seating patterns 
and the covert and informal network of felationships and^norms are attended to 
by the staff mec^ers observing in. the cadre meetings, ^e observations will 
be content analysed for themes md categorized in tern^ of the^^cultural uni 
versals framework described earlier. 

3. Interviews 

Interviews may be formal or informal and both are being used in this 
case. The ethnographer relies heavily on the key iuiiormant interview to gen- 
erate data; Key informants are members in good standing of- their- culture or 
subculture. Attests are n^de to work with inforMnta numerous and different 
enough to represent all major aspects of the grjupCs) under study. Hierefore, 
all medbera of the Hinton School faculty and atoinistration will be involved 
in formal extended interviews concerning their/i^ressions of the culture of 
the school and cadre members will be interviewed formally once and info 
several times, regarding the subculture of the cadre. In addition, several 



role groups''KSve been selected for frequentyinformal interac 
views, such as the preeervice interns stationed at Hinton, role specialists^ 
-males -in a predominantly female school and/ paraprofessionals who live in.-the- 



-school/conimunity. Formal interviewi are being conducted with ten designated 
CMjiranunity leaders ^ a Informal interviewi ^ith a group of parents \7ho have ^: 
^assumed a leadership position in the school/comnmnity. In the other cadres, 
the administrators; seleetedparaprofes teachers, parents^ and head , 

teachers will be interylewad formally. Finally, Inf omal interviews have been 
conducted and, in June, formal interviews will be conducted with central staff 
members to tap their contributions to, i^ressions of the program, school : 
and cadre subcultures* ^e prograo staff evolved its own values ^ technology, 
governance sys tarn and so on ^Ich was' parallel to^ but affected the develop- 
ment of the cadre and the curriculum. The interaction of these subcultures 
^fill be described. 

Frequently J the investigator comas to depend on those few members of the 
group who have the time and desire to talk with him* This may induce a bias 
in the data. To avoid this bias, the two staff Interviewers assigned to the 
progrmi partieipanta will eKchange key informants for half the formal inter- ; 
view sessions and compare responses for discrepancies , Appropriate- adjustments 
"will be made if necessary, ^e formal incerviews with key informants will^^^^ 
minate the first year of ethnographic data collection. The time span should 
permit the respondents to faal comfortable with the investigator* Tha great- 
est problem for the investigator is to establish trust while maintaining objec- 
tivity toward tha rasponses given by the informant* Approximately 70 two hour- 
long formal in tairviews will be conducted in March, April, May and June of 1977. 
: . The iritarview schedules ara designed to corraspond to the cultural unlver- 
sals framework presented earlier* Data will ba content analysed in terms of 
the eight categories which will ba changed only whan the data raveal crucial 
alaments of tha subculture not anticipated in the framework or. not pravioualy 
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ancountered. Pilot tests with the open ended schedule were conducted by the 
author last. year at the Hinton School and four other similar schools in -the 
district. The data ware rich, interesting and greatly augmented the demo- 
graphic and survey Information collected from each site. Whenever possible 
quantitative material from observations , surveys, documents and other sources 
will be used to support genaraliMd itatements made on the basis of data from 
the interviews, Sa^le Interview questions in each category are shown in Ap- 
pendix A* 

ti-, -■- - ■ - - . - -. ... - - - -. . _ 

4. Content Analysis 

Content analysis of written documents or interview data Is another method 
of systematic observation and measurement of variables.^ Content analysis 
will be used to analyze in, an objective fashion the themes, patterns, content 
and intent of written communications such as logs, ;bulletins, cadre minutes 
and agenda, staff agenda and minutes and. other program conmittee minutes, in- 
stitutional reports, correspondence, interview data, etc. In this technique, 
questions are asked of the comminicatlonB rather than of the Informants or by 
directly observing behavior. Written material la a form of behavior which can 
be analyzed and inferences can be made about the nature of the group oi^ .Indi- 
viduals producing the conmunlcations . The basic skill required in content a- 
nalysls Is to set up workable categories and a logical classlf Icatlon system 
which relate to the research problem and the conceptual assumptions. The 
.logical classification system has been established In the cultural unlversals 
framework I the workable categories given the nature of the culture and-subcul- 



Ip Kerlinger, Foundations of Behavi oral Research, pp. 543-553. See also 
B. Bereiaon, Content Analvala In Communication Reaftarch (New York? Free Press, 
1952) and C.E. Osgood at al. The Ifeasurement of Iteaning- (Urbana, 111. ; The 
University of Illinois Press, 1957). ■ - ■ ■■■■ ■ / 

: - 43 -~ - - 
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turaimder examination include such content categories as distribution of eur- 
rlculum matefials (technology), staff time allocation (economice), groupings 
of pupils , parent^ p admlhis trators (social organisation) ^ program content (val 
uee, technology) J decla ion making- strategies (governance) , voluntary groupings, 
discipline (socialisation) , instructional strategiea (technical language) j .Qp,- 
portunltles for interaction an^ng staff* --nie unit of analysis in this 
case is the theme (a phrase or sentence related to a content category) and re- 
sults will be reported In frequencies and percentages, ..^.r: 
Content analysis is a simple but laborious and time consimiing analytical 
technique and should be used when data cannot be obtained in other ways or 
when written materials are a crucial component of the culture. Given that 
schools are literacy training institutions and that written dociments are the 
principal cultural artifacts of a program culturep they must be examined In 
detail for insights into the cultures^ of each, 

C. Preliminary Analysis/ 

It is premature to attempt to present any complete description of the 
Giilture of the Hint on Elementary Schoolr'the cadre and the program at this 
tlme^ with less than a year of observations and incon^lete interview" data and 
only partial analysis of the written documents. Therefore, what is presented 
here reflects the preliminary informed Judgnients of the ethnographers based 
on co^arisons of observations and interim reports of program and cadre func- 
tioning. The findings should be regarded tentative and in need of further 
documentation. The temptation to generate research hypotheses has not been re- 
sisted for the observation arid interview data proylde fertile ground for such 
speculatloni. 
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1. The Culture of Hlnton SehoQl r A brief description of the nature of 
^^thevstudent/ parent and prof©ailonalpopulati©n earlier* To 

^ gUTOiariaie the demographlQ information colleeted, Hinton Elementary School ±b 
. a K"6 facility with a student population of /approximately 835, serving a low 
income black eommunity on the south aide of Chicago, There are two admini- 
strators * a .principal and an assistant, 6 role specialists and 40 teachers of 
whom 3 are male* There are 4 white teachers on the faculty and the rest are 
black . Eight paraprofesslonals work at the sehpol which provides breakfast 
and lunch to the children* The s't^^^ the typical pat- 

tern of regression from the third grade on r^^^ average, children are 

about tS^^on the jcIow national norms by ; the time they reach^ 

In capsule form, the needs assessment data and interviews reveal that 
the world view of the -parents and the teachers in the Hinton school/community 
culture Is very congruent with respect to the children, For^both, reality 
consists of adequately preparing children to ; complete their educations, at 
least thrpugh high school. The process should mdceth^ children self suffi- 
cient^ aconomlcally and personally, B dally reality of the 
various adult role sets In the school/comiunity Is quite divergent* For the 
parents s reality is survival "and protection of pers^^ and property 
-from encroachment by the various coi^ crime, and the legal 
institutions of society which often are seen as hostile. For the teachers, 
survival is Mlntaining order/^coverlng" a designated Mount of material, meet- 
ing extra class responsibilities, snatching soma moments with other adults and 
"making it through the day." For the administrators, reality is meeting the 
daily crisis, allocation of goods and htman resources to meet health, safety, 
custodial and instructional requirements and satisfying the requests of some- 



times remote suparlors. Reaplutisn of eaeh issue for each group results In 
feelings of security, status and/or sociability. 

The value svflteHi of the Hlnton school/eommunlty was tapped in the spealf 1- 
catlon of goals cltad in the quantitative section of the paper. Parents and 
teachers feel the school ought to teach children to be literate, self respect- 
ing and respectful adults who are capable of belngvprpductivs persons in the 
Boeiety. Howaver j they see each other as sometin^s ic^eding . the childls prog^ 
ress toward these desired ends * Both groups endorse the core ^^srican values 
of self reliance and egalitarianism. 

The social organization of the Hlnton School is typical of the structure 
of most elementary schools, that is a relatively flat bureaucratic pyramid with 
the principal at the apex and the children and parents at the base* Other 
social groupings are related to grade level taught, quasi-administrative status 
attributed ttf lack of regular classroom responsibilities and inforaal affilia- 
tions on the basis of race, sex, age and years of experience at the school. 
Variables such as the Influence of socio-economic status, residential patterns, 
marital status and educational levels require furthe%^supportlve data before 
comnents^can be Mde about their importance in the social organlEatiori of the < 
faculty. The shortened school day at the school limits the nu^er of adult in- 
teractions possible and this may be the most crucial element in the absence or 
formation of kin-like groupings*. 

The technology of the school has both a" formal and an informal component. 
Written documents and initial Interview responses suggest that a central office 

mandated continuous progress/MStery learning teaching strategy is the major 

■ . . ■ ■ ■ ■■ . ■ - ... ■ .... ^ . . . ■ , 

ins true tlonal mode at the school. However, the analysis of a small nu^er of 

informal and key Informant interviews indicates a gap between what is said and 
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what is done in the classroom for Che larger part of the faculty. Observation 

reveals the self-contained classroom is the chief settli^ for- instruction, - — 
Most classes have about three achievement levels and teachers functioning 
the "leader of the group" instruction role. • The completion of-the Learning Environ 
ment studies next year and the accompanying classroom observations should pro- 
vide insights Into the actual process of instruction. There seems to be an un- 
willingness tt» try new techniques without almost daily guidance and class sup- 
port. 

The p-conomlc avstein Is characterised Sy centralization of the distribu- 
tlon of instructional materials In the area of the administrative offices and 
allocated by non-classroom staff. The allocation of adult human resources Is 
the prerogative of the principal or his designee, with the exception of the 
maintenance staff whose actlvitlesrare specified by the hulldlhg engineer. The 
use of student-time Is almost exclusively the function of the claBsroom teach- 
er with some concessions made to role specialists such as reading teachers, 
librarians, gym and music teachers. Given the city-wide fiscal and promotional 
incentive system, the few economic rewards available at the local. school level 
seemingly do not generate a competitive spirit. Additional data are required, 
before specification of the Informal set of norms which govern the allocation 
of these rewards. Speculation Is that power in the system is related to the 
receipt of these rewards dispensed by the administrator and the engineer. 

The governance structure at Hlnton School seems to be as participatory as 
possible given the constraints of a large urban school system. The administra- 
tor seeks input from faculty, has continuing contacts with the opinion makers 
and does>alue negotiation as a conflict reduction mechanism. The lack of 
formal grievances" brought by the faculty Is one concrete indication of this 



faculty perception of aGeeasabiU one group of faculty makers w^^ 

^kprais the desire for more directive leadership and more decision- 
making on the part of the principal. ^ 
The s ocialization procegi has bean examined with special efflphasi8>b^ 
acculturation of the pres entice Interns In the into the Hlnton school / 

culture, A rite de passage has been outlined and the Sj^ are keeping loga^t# 

to document the process, Crueial variables In the system's acceptance or re- 
jection seem to be^^^^^^^d -to rye^ ^rtl^ tasks for . . 

members of the^ sc^^^fcomflmnit^r cultiiM control children. Cer- 

tain personality variables sn^ tlia part of faculty and interns are under Inten- - 
give exa^nation for it seems that a selectlbn model f or compatability and 
productivity might be posited and related to site specific conditions* For 
exan^le^ it aee^ls that open-minded teachers with tradltionai values work best 
with preservlce Interns with high self esteem and a Qontent speciality, in a 



team teaching self-contained classroom setting, - 4 

The language of the system has Its own; unique features » but the major pat- 
terns are reflective of the educational prof esslon, the ^middle and lower middle 
class background of the teachers, the athnie and soQloeconomic elements in the 
comflttinity and the peculiar variations generated by the presence of the university 
staff and program J argoHi^ 

2. The Subculture of the Cadre s ^ Ifiich lOf what has been said of the Hlnton 
school/comnrunity is reflected in the Hlnton cadre with the exception of varia- 
bles of sociai organisations norms and values , and governance* The group de- 
"blded that they wished to operate on a consensus model with a convenor selected 
from their membership, llie first convenor was a volunteer, a feniale classroom 
teacher. The second convenor approaches ^e administrative model in that he is 
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n©t a regular classroom taaeher and is keen to have some quasi-adniinis trative 
funetlons. The rapidity with whieh , males in the eadre^saumed leadership po- 
sitions is related to the rola of the male in the largMy female elementary 
sohriol culture and requires additional investigation. The eadre is still 
grappling with the probleM attendant to the development and enforcement of 
norms and values. This procesi is further complicated by the presence of 
"outsidars" in the persons of the interns^ though they are less outsiders 
than mambers of the project and unlversiyr staff. The tendency Is to relin- 
quish leadership positions to the university personnel and to avoid any sit- 
uations which will lead to conflict with administration. 

While It is too soon to say definltelyp there seems to be the develop- 
ment of new social groupings In the eadre which are_ not present In, the larger 
system. Coalitions of parents and teachers and Interns are present, work 
groups Invqiving faculty menfljers of different status levels have formed and 
university staff and- classroom teachers are functioning In dyads to address 
specific instructional problems. The duration and impact of the groups on 
the larger system remains to be seen. _ ^ _ _ 

D, Ihe Limitations of Ethnogranhic Analysis as an Evaluatio n Methodology 
Thm ethnographic model is descriptive and provides a wide range of in- 
sights IntiB^ the processes and patterns of the culture of the school and the 
eadre. The'coi^leted ethnography will generate a wide variety of research hy- 
po theses, requiring" detailed examination. For example, the special status of 
the role of the male teacher in the predominantly female elementary school cul 
ture may change with the evolving role of the woman In the larger society. In 
dications are that schools lag far behind the general culture in sex role so- 



i;^gis;;5nie^ is not predictive. Because each school culture is unique, until 

pi:^';e\>niDdal' profiles of a variety of cultural t3?pes can be devised, it .will not be 
l^rX: P^^^^-ptlve, Currently, school ethnographies are rare because" they. are' so tlma 

^ eonsumlng and require trained anthropologists as field workers and analysts . 
rij;^ Hopefully, the research being conducted here will contribute to'tha body of 
i|^^^;%knowledge required to develop a predictive ethnographic model. It should be 

program replication requires detailed descriptions 
and analysis of all elements of the endeavor. 



The quantitative and ethnographic analyses provide both formative and sum- 
mative evaluation information. The next two techniques, historical and mana- 
gerial, tend to be escplicltly suomatlve. Nevertheless, both the historian and 
cinanager Ifflplicitly make formative evaluations i and rare asked to share these ^ 
Judgements on an informal basis with program staff and participants* These 
two perepe c t Ives as in^ lamented in the Roosevelt University Teacher Corps Pro-- 
gram and as reported here are complCTenta^ for the discussion of the historical 
documentation presents a model and the managerial- analysis presents data to be 
processed by the model- ' v-v 



:'IV. The Historical Method , ... 

= '=-^^ The place of the history in evaluation lies between raw chronology 
I and summatlve statistical techniques- Haw chronological, the recording of 
events^ can be obtained by perusal of agendae/and minutes which result 'from. ' 
program commltteae meetings. A history must place this chronology Into - ' W" 
perspective. Similarly, it la through the eyes of the historian that the 
long term in^llcatlons of scatisticar data can be appreciated. Means,' stand-^^^^s^^ 
ard daviations, Md F-ratlos need the^ historical background in order to be- 

' 1 • /, . ■ 'it? 

cams "hiaaanlged", / 

f - ■ -'Si 

Giyan. that a program history is a viable evaluative technique, it is >1?^ 
inctnabent upon the historian to Identify the crucial elements which make up ^f:jf 
a "history". Examination of ^theae elements * or "phaaas** in asseinbling a his- 



tory. can...then_lead .. to;,an^imderst of the^avaluative_jiature^of_hlstorical_A 



docimantation. ^ ... , 

■ The initial phae^ In: the^ construGtion of a history coneiata in the gather- ^^ii? 



Ing of primary source; informatlpn,^^- I ie /aKiomatic that the more exhaustive 
the search- for -prlmary^vBOur is . 

developed. ^ ,^ 

The second phase in historical evaluation involves developing 'a' frame 

of reference with ^which to view the primary source data. This "frame of % 

reference'V may bermore Iposely^ t duty of the' 

historian to 5 in aoaaobjecti^ the chaos o^^^^^^^^ an ^ongoing functional 

entity* The fr^e of reference :1s cFuotal In^making the leap from chaos to 

order*--' ■ ^- ■ -■ ----^ - --y\- ■ :~ 

-. - . -/T' ■ - - ■ - • ■ - --^ 

The thirii phase in historical ahalysia:4ls aKpoaltory In nature: the 

project bal^g evaijia ted :;auat ba^^ parameters set up 
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^&;fff^^^^ the jtraniR of i re-*erent:^ • What were formerly mere occurrences become 
:>"events" which relatt to other. "evenCeV,: and which, as a totality, give^ 
usV a picture of the courp^ which a given portion of the project; has |tkkan. 

The final phaH> 1 > c;onstructing a history involves generating /Jmlle- 
stones" and "influ>.iif Cert;ain events, when the occurences of the pro- 

ject are placed in 1 frame ct*. refer en ce, become paramount in importance, 
and the historian rfef^rs to tht.se events as "milestones". Once the "mile- 
stones" have beanvs^^/'i^.i^^^ milestones had on 
the projact may be f^a^^^Mated/,^ Piston in the 
history as follows 2 : ; , 



■ m 
^1 



Phase I ^ 
Gather Primary 

; Sources: 




Phase XI 
D aval op Frame 
of reference 



Phasa III 
Explanation 
of Events 



;.; Phase IV 
Milestones and 
Influences 



Result J 



Corpui of Primary Sources 



Result g ; 

A "perspective" with which to 
vlaw^ primary source corpus 



Result I 



Occurrences from corpus of primary 
source become ''events" In frame of 
rafarence V 



Result: 



The Histoid of the Project 
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History is a critical science which miiet estimate what, of all the 
developments which happen to mankind, ip to be counted aa progreas- This 
estimation creates the phenomenon of historical teleology which must be 
recognized as a source of error in any history." 

To counteract as much as possible any error which say result from his- 

/ - 

torical teleology, the collection of primary source "data must be as complete 

. ■ • . ■ - . - . . , . . . ^ . _ _ .... . . ....... 

. . .. . ■ ■ ■ . ■ ... — - I :■„,.,, ..- , • . - .- ■ , : : . - ' „ 

... ......... ...... -- . -. - .. - . ......... ^- . . . . .. ... . -. ^- ..: . . 

as possible. Additionally, these data must themselves be the source for gen^ 
erating the frame of reference, lest individual/preferences* distort the occur' 
rences being considered* However, the historian will always be faced with 
possible error because occ\irrences ,_ which b e come even t s ^ ■ which become mile^ 
atones which have influence all have their genesis in the eyes and mind of 
the historian, and his colleagues - 

The history of the Roosevelt University Teacher Corps Project will in- 
volve all four phases which have been diicussed earlier. Because the nature 
of the project is that of a transactional system, the history will be shared 
with project participants as it is being constructed* In this-way , it= is 
hoped, an objective historical analysis ^of the project will be produced. 

There are three types of primary sources which are being collected for 
the history. The first type consists of all memoranda, agendas, and ^minutes 
of meetings, which are being kept and filed chronologically to facilitate re- 
trievalV Discussions wilh project staff and participants is the second type 
of primary source data being acmimulated*. The third type of data consists 
of - previously prepared documents concerning the research site. These Include 
hiatoriea of the schools inVQlved^ in the project, Chicago Public School Sur-- 
veys concerning faculty composition, and students ■ previous testing data. v 

_ %ilhelm Windelband- A History of Philosop^ r' Vol, I & II. (1901: Re- 
printed by arrangament with Macmillan Co New York, translated by James H. 

Tufts.) ' - ~ 



The development of ^. frame of raferanee for these data ie atill in 
jprocess* Tentatively, it appears that all data will be categorlgad as re- 
lating to one of these four parameters £ 

1* Organisation and. Management ' 

2- Participant Profiles .- . . . , •; • • 

3* The Coimunlty 
. 4* The. Evaluation of In--Servlce Curriculum 

Under "Organization and Management" will be included Items on personnel 
and dec is ion- making* The "Participant Profiles" wJrllv include all information 
regarding cadre formation* Inservice participants and course enrollers. ^ 
active conmiunity necessitates separate consideration of - the reciprocal im-- 
pacta between the Teacher Corps Project and the Coraunlty. Finally^ infor-- 
mation on the curricultan per se ^ md ite growth and changei will be included 
in a separate category* 

Yet to come in the course of the history is the construction of the 
"story" of the project, as viewed .through these par^eters. Still further 
in the future is the establishment of "milestones" md "influences"* Close 
sharing between participants^ staff and perhaps students in the schools vthem^. 
selves will be required before recognition of milestones and Influences can 
be realized* 

Limitations of the Historical Method _ • 

The hlstoryj or "teleologlcal assessment" of the projects is fundMental- 
ly a "post facto" analysis* Its chief value lies_ in how it may be used in 
future projects similar to Che present one* Particularly with respect to 
milestones which seemed to have had a deleterious influence on the course of 
the project J future researchers would do well to notice tht occurrence of cor- 



responding events in their own projects, Parhaps than by careful planning 
these future projecti would circumvent any difflcultlei found in the present 
project* Although In doing this other researchera may be perpetuating a 
post hoc ergo propter hoc fallacy, consideration of other summative evalua- 
tions of the present project could counteract this to a degree. 

- - : . ■ ^ • , ' I : „. _ - 
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V, Managament of a Teachar Corps Frolect hy_^ Trans_ae Clonal Style of 

Organizational Analysts and Evaluation 

A. Rationale for Managterlal Analysis as Evaluation 

Convantional wisdom calls attention to the notion that a new and oompll- 
catad venture requires "good" laadarship^ managament that is infomed ^ sansitlve 
and goal directed. The procasaas of the leader and his or her managament atyla 
have been eKamlned by res'earchars in psyehologyj sooiology, education and in^ 
dustry^/^ The invastigatlons reveal that the "successful" manager and /or ma na** 
gerlal taam are thosa which can as tablish goals and procedures to accomplish 
them^ and identify prob lams related to the pursuit of goals, of staff function- 
ing. Improper allocation of resources^ cdmmunicatlon networks. Thenj formally 
.or informally j informatidn is collactad from a variety of sources, analyzed by 
the manager and his staff, a dacision is mada^ Implemented and evaluated. The 
whole process bears a great resemblance to the traditional program evaluative 
process^ with one major difference* The manager rarely makes the process explicit^ 
but frequently keeps the whole procedura in his head,- The notion here is that by 
making the managerial process explicit the project is viewed from another frame- 
work, and a new dimension is added to the transactional evaluation model, Furthari 
detailed records of the managerial mode of experimental projects may provide ad^ 
ditlonal insights into why some projects survive, prosper and influence education 
and why others fall. 

The pDsslblllty exists that managerial analysis and management infomatlon 

- = - • ' ■ . • • - . • •• • • . . . • , • • • • . ........ ^ ... .. - 

systems are not useful evaluation tools, that their techniques are too casual and 
that the data generated is best dealt with in the historical and/or ethnographic 

■."'v-.^See for example Harold J, Leavitt and Louis R. Pondy, Readings in Managerial 
Psvchologv (ChicagQi Univeraitv of Chicago Press, 1964). 



models. This possibility is open for eongideration by the program staff and 
the scholarly eoiDmunlty* 

B. The Conceptual Baae for Program ttonagement 

The management of the Roosevelt Unlveralty Teaeher Corps Project la based 
primarily on the Getzels-Guba model" of social interaction. 

Getzels and Guba defined three leadership-follTOahip styles as follows in2B2= 
thetio , which emphasizes adherence to role eKpectatlons and the requirements of 
the institution, such as an asaembly line| the ideoRraphic ^ which emphasized the 
need-dispositions of Individuals; an eKample Is the organization of a basic re- 
search division in industry; and trarirtctlonftl ^ which emphasised the Interaction 
of the two, ^ Since the Ropsevelt Teacher Cbrps Project Is^^ concerned 
irtth the imporvement of teaching-learning :in an in 

schools^ the transactional style is most appropriate for making those decisions 
which can effectively Implement this goal, 

Bius/ in developing the proposal for the Teacher Corps Project^ a transac- 
tional model of governance for the project was delineated which emphasized three 

...... ■ , . : - . ■■. : ; - ' 3 

basic principles of parity. Interface of roleSj and negotiation. 

Parity was designed into the organic tion through the mechanism of four com- 
mittees: Executive, Coordinating/ Curriculum, and Planning. Each of these commit 
teas is a separate entity in having its own sphere of irtfluehce which determinee 
the implementation of project objectives- Yet all are intartwlned and work to- 
ward a harmonious whole. - 



^Getzels, J. and Cuba, E.G. "Social Behavior and the Administrative Pro- 
cess,'' The_S^ool_JevlM, Winter, 1957, 

2G^tzels/j. . Llpham, J. and Campbell, '.'fedueatlonal Administration as a 
Social Process . New York; Harper and Row PubtlStteif'i, 1968. 

: %cCampbell, James,"A Tranaactional StyXfe of Organisational Management," 
University 'of Chicago; Ford Training and Placement Prdgtam News Briefs, 1973. 



The chart shows me^ership on the various cofflmitteea by roles . 



Number by Eole of MeiAarshlp on Governance 
Conmaittees of Roosevelt Unlvarslty Teacher Corps Pro.lect 






Role 


Exec. 


Coord. 


Curric. 


Plan, 


Co^sn* 
Total 


University Admlnlstratora 


1 


- ; 






1 


University Faculty 


2 


- 


1 




3 


Teacher Corps Staff* 


2 


11 


; 3 


3 


19 


LEA Administrators 
Central Office 


1 








1 


District Office 


2 








2 


, Local School 


3 


1 


1 


2 


7 


IMA Teachers 


1 


1 • 


3 


3 


8 


Comiunity 


A 


1 


1 


1 


7 


Interns 


1 


1 


1 


1 


4 


Total 


17 


15 


10 


10 


, 52 



18 



*A11 central staff members have administrative and/or teaGhlng experience 
at the elementary and/or secondary level. Further, they all have votes 
only In the Coordinating Committee. 



The Executive Comiittee Is co-chaired by the Dean of the College of Educa-- ~- 
tion and the District Superintendent of District 21, a sub-district in the or- 
ganisation of the Chicago Public School system. Having these two men closely 
, involved in helping to set policy for the project seta a tone of Interagency : 



respect for the project which it ^otherwise might not have. The project is 
regarded as an important part of the activitlea of the College of Education 
of Roosevelt University, In the fields the activity of the District Super- 
intendent indicates to the central administration of the Chicago=^P^llc 
Schools his respect for the goals of the project' as well as communicating 
to the slte--coordinator or principal and teachers of the school in which 
the project operateSi his unqualified support as well. 

The Executive Goiraiit tee meets monthly, alternating meetings at Roosevelt 
University and in the District 21 office. Its agenda are prepared by the pro- 
ject director, Forinal minutes are kept of Its deliberations- Its basic func- 
tions are to be concerned with the financial management of the project and to 
make major policy decisions for the project. Its voting membershlpi in addic- 
tion to the two co--chairmen and the project dlrectori consists of the assis- 
tant director of the projects the site-coordinator , principals of the two 
other schools Involved in the project^ the Local Education Agency (LEA) coor- 
dlnatorj two members of the College of Education faculty s four parents who 
represent the three schools, a mender of the District 21 office, an intern, 
/this IS one of four young people who are working for Master of Arts degrees 
In Teaching In a two year program of formal course work and school and commun- 
ity servlce£^/s and a teacher representative. 

The membership of the Executive CQflroittee was specifically designed to 
provide a parity mechanism for all aspects of the p^roject—University and 
L^^caF^du£¥tloMi^^ faculty membere of _ the College, 

of Education whose primary responsibilities are concerned with the project and 
College of Education faculty members who are interested in the project but not 
project staff members, members of the commiicy, administrators, teachers, and 



interns. They also represent all levels of an administrative hierarchy. 
The Coordinating Commlttae is priniarily a staff communication and 
. planning comittae. It is chair^ by the project director and consiits of 
all staff meid^ers affiliated with the project and an intern representative. 
Again the meirfcership of this comnittee is an illustration of the parity 
principle resulting frora the process of negotiation . Three maobers have 
been added to its nieE^ershlp not only to ii^lement the democratic principle 
of parity* but also to indicate to all concerned with, and Interested in, 
the project that it operates in an open manner. Iliese Include the site-- 
coordinator or principal of the schools the co^coimunlty cadre coordinator 
and a teacher representative of the faculty of the Hintpn school, Increasei 
mendsership in this committee also illustrates another facet of the smooth 
interface of the local school and the University, 

At the onset^of" the project J this conaalttee met weekly^ but now finds 
that bi-weekly 'meetings are sufficient for project purposes- This coranittee 
also has a formal agenda and keeps detailed minutes of its proceedings- It 
is in meetings of this comflittee that no detail concerned with project oper-- 
ation and management is too small to be discussed* > , , 

In preparation for the work of this committee, the director carefully 
analysed the project proposal before the start of the school year and devel^ 
oped a managemant information system (MIS) for consideration of the staff . 
This system has three major characteristics r (1) it defined the eight major 
ta^ks of the project; (2) tentatively listed the persons responsible for 
each major task as well as other staff meters who were to become involved| 
and, (3) set time-lines for the accomplishment of the tasks. Major tasks 
included: (1) operations of the project; (2) conducting a needs asseeament; 
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(3) retraining experienced teachers; (4) orgmizlng and operating a teacher 
learning center; (5) training pre-service internsi (6) providing a co™unlty- 
based parent education program} (7) evaluating the project J and, (8) dociiment 
ings disseminating, and demonstrating major facets of the project. 

Moreover, the management information iys tern provided for a breakdown of 
the major tasks into subtasks using the same framework as for the major tasks 
namely^ a description of the subtask, the person responsible and others in- 
volved in the s^task, md a time--line* 

The management information system was also restructured into major tasks 
and subtasks to be performed by each staff mraber including the director^ 
assistant director, program development specialistv team leader, community 
coordinator, needs assessment coordinator, and the exceptional child coordi- 
nator who also serves as project historian. For each staff me^er major and 
subtasks were grouped for that person either as being responsible for tham 
or being Involved with them. Each subtask was given a classification num- 
ber which could be coordinated either imder the heading of tasks or subtasks 
to be performed or to the specific individual responsible or involved. Again 
each subtask was described briefly and time-lines defined, v 

Wien this system was fashioned, coimnents, suggestions, and revisions 
were solicited. Again, the principle of negotiation concerning staff respon- 
sibilities for tasks opera tedV Staff members were given the opportunity to 
meet wjth the director or to submit suggestions for revision in writing. It 
is interesting to note that only a few minor suggestions for revisions were 
made. Thus, the management information system as devised by the director at 
•the beginning of the project became the major frame of reference for staff 
planning and operations. * - 



toreover the management Information syet^ (a managarial analysis 
system) is a good evaluation tool in that it provides for both formative 
and ultimately auimative picturea of the status of the project. The eys^ 
tem identifies the changes that have to be made in the managment of the 
project in order to facilitate the baiic goal of the project, changes in the 
currieulim of the school. This method of evaluating both process and producte 
is also consistent with the transactional evaluation scheme and the aocial sys 
tem design ©f the project. Put more sls^lyi it is another way of "getting a 
handle'V on a complex project which may be replicated* The data generated by 
the MLB have pointed to redirections of staff ^ergles at certain points in 
time* ' Thus subsequent changes were made as the project operated* For the 
most part^ the changes were negotiated with the appropriate individuals and 
agencies* Occasionally the negotiations became confrontations usually because 
the principles of parity and liaison rolea were violated. Some examples, are 
given below. 

The Curriculum Comittee also began operation at the onset of the pro-- 
ject under the co-chairmanship of the assistmt director and the site coordina- 
tor or principal. Again formal agenda for each meeting were prepared and min- 
utes taken of proceedings. This committee also meets monthly and alternates 
meeting at Roosevelt University or in the field at the Hinton SahQol» An L^-^ 
tern is a mei^er of this committee In addition to project staff meafcers* a 
member of the College-of Education faculty kno™ for her expertise in curri- 
culum matters, a member of the coraaunlty cadre, and three teachers of the 
Hinton^ School. Againj, the principle of parity has operated in the designa- 
tibn of roles for members of the committee in that they Involve staff most ^ 
concerned with the direction of the curriculum of the project, teachers who 
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aife coneerned with the teaGhing/learnlng in thair elassraoms, a currieulum ck- 
pert, the adminiitrator of the school which is the locale of the teacher learn- 
ing center^ and members of the coomunity- 

Thls committee j as its name impllesv-i§ mainly cpncarned with broad policy 
mattara pertaining to the selection of inacruction materials and equipment for 
the project^ the allocation of project staff for instructional taekSj and the 
recommondation of curriculum directions for consideration, study and delivery. 

The project proposal called for the formation of a cadre not only at the 
Hinton School in which the project's teaching learning center operates, but also 
at two other neighboring schools, the Parker Child Parent Center, a pre-school 
facility, and the Banneker Elementary School, a kindergarten-sixth grade facili- 
ty similar in grade range to the Hinton School* - ^ 

Because much staff energy and time was utilised in beginning the project 
operations, formation of cadres at the other two schools was delayed until 
January s 1977, Furthermore, it was not posslbre to form a cadre in each of the 
other two schools, primarily, because staff resources were not available for 
two additional cadres. Tlius, a Parker-^Banneker combined cadre was formed. 

The fourth committee in the governance structure of the project, the Plan* 
ning Cosmiittee , consists of representative members of each cadre in addition to 
staff personnel, it meets monthly and Is co-chaired by the two cadre liaison- 
personnel (staff resource perstii) who work with each cadre. Its major function 
is to sift the ideas of the members of the committee in a cross'^cadre relation- 
ship to the mutual benefit of both cadres and the respective schools which are 
represented and to plan cross -cadre activities. , . 

: /Again, an intern serves on this commit tee. Thus, each of the four interns^ 
assigned to the project serves on a major governance committee of the project. 



a further Illustration of parity. Interns compare notes on their perceptions 
of the Gonimittees at their own weekly meetings conducted by the team leader 
^ose primary responsibility as an eKperienced teacher is to smooth the transi- 
tion of raw, proBpactive teachers Into finished teachers capable of ^ 
and instructing in inner-city dassrooma. 

Interface is defined as the quality of interactioti among the various role 
groups and agencies involved In the project, in this case managerial, and other 
external forces, which either Impinge upon It or with which It has to deal. 
Good relationships result in a tight inter£ace,_ie8B than good reUtlonahlp^^ 
result in a rough Interface. The director is Involved la three -major Inter- 
face roles within the University/ with the m, and with the Teacher ^ C^^ 
bureaucracy. Several examples are given below which Illustrate the kinds of 
problems which face those who function In the liaison roles at the interface 
of participating institutions. 

Working with the Controller of the University and members of his staff 
has proven to be a revelation to the project director and has Involved more 
time and effort than allocated In the MIS. The first Important contact with 
this office came when it was time to secure tuition vouchers for the Interne 
at the beginning of the fall, 1976 semester. It was not until the director 
personally intervened with members of the Controller's staff that the problems 
facid by the Interns at each step of thr registration process were solved. 

The auditor assigned by the Controller to keep the University's accounts 
of financial transactions required by the project now consults with the pro- 
ject director ten days before the end of each quarterly report period and al- 
lows herself to be guided by the suggestions of the project director, who 
keeps his own set of financial books in allotting credits and debits to varl- 
oiw line Itenis in; the budget; Personal negotiation with the Controller by 



thm project dlreetbr also sCTalghCened out errors In lalary payments to staff 
mtniera end to a policy whieh permits the director to personally be responsible , 
for the distribution of monthly salary ahecks to field peraonnel. 

Although the project director is a former high official of the central ad* 
ittlnlstratipn of :tha Chicago Public SchoolSp relationships with that office have 
proven to raguira more time and effort than anticipated in the managerial in- 
formation system* By Teacher Corps regulatlonip the salary and in**clty travel 
expenses of the team leader, salai^ payments to the InternSp and the salary of 
a secretaiy In the field of flee are u^der the juri the local educa- 

tion agency (LB^) * This has bee^ done for a number of reasons includlng^be 
most imp^ort ant- -that of wanting to elicit a reasonable level of support . for 
the project *by the school system in which a project operates. 

There have been numerous^ difficulties with lack of salary payments to the 
team leader,' tardy payments to the interns^ and the J.lke« Not all of these 
evidences of contention have yet been satisfactorily solved despite much person* 
al and x^itten attempts at negotiation by the project director* It may be that 
negotiation of unresolved fiscal items with the national funding; agency may be 
the only way to conclude the. concerns regarding allocation of funds by the LEA, 
>toreover, the involved routine of lane placement credits for participants 
in such courses under project auspices continues to be a negotiated item at each 
step of the^process. 

^ -There has been, however, one exception to the gloomy picture noted above. 
At the beginning of^^ the project, the central office indicated that It had been 
requested by governmental of ficlals tb of fer for sale to the highest bidder the 
closed circuit television equipment now installed In the Hinton School. This : 
equipment had been in use In a closed circuit television hookup as part of an ~ 



District 21 office, a move which had bean made necessary by the fact that the 
school was not permitted to hold meetings beyond 4j00 pm, (Later It developed 
that the principal was able to iecure a permit to keep the Hinten building 
open to 5:00 pm.) They also requested that those members of the cadre who de- 
sired University credit for partieipatlon not be held for written work of any 
kind. 

Core staff members readily agreed to the first two r^uests— that of 
making in-^service sessions involuntary and that of holding cadre meetings 
at the Hlnton School. They also suggested that members of the cadre should 
take more responsibility for determining their own agenda and only one cadra 
liaison person, the teM leaders would function to work with the Hlnton cadre 
instead of the four staff members who participated in cadre raeetlngs in the 
fall semester in order to lessen the feeling of staff direction of the cadre 
voiced by some cadre members i 

However, the project staff "stuck to its guns" in polnting^out that no 
University course in the College of Education worthy of the name could func- 
tion without the request for some kind of written papers, Furthermora, it 
was pointed out that Chicago Public Schools policy for salary lane placement 
courses required evidence of a formal nature. ,TOis position was accepted by 

the faculty negotiating team. ^• 
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Core staff also suggested that an addition to the membership of the Co- 
ordinating Comaittee be made in that one classroom teacher was to be elected 
to represent the faculty at meetings of that cotmnlttee. The chairman of the 
faculty negotiating coDmit tea was promptly nominated to serve in this posit ion . 

It is interesting to note that careful negotiation with consideration of 
all viewpoints without rancor actually resulted in improvement in project oper- 
ations. Participation in morning in-service sessions is now voluntary by 



teaohez'si the nnmhar partiQlpatlng now is no less and in some cases greater than 
-it was at the eompulsory sessions held in December « Moreover, there la a great* 
er interest on the part of the teachers who do participate and the tone of the 
sessions has i^ roved greatly; these taaahers^ too, are beginning to incorporate 
into their classroom activities some of the suggestions oiade by project staff. 
In flUOTg^ t the transactional mode of managerial analysis has served the 
Roosevelt University Teacher Corps project well by providing for parity in its 
gDvernance structure^ pemitting the director to develop strong interface rela^ 
tionshlps within the University, outside of the Unii^areityj and with other 
Teacher Corps projects and programs; and by practicing the principle of negotia- 
tion whenever and wherever It was expedient to advance the goals of the project^ 



VIp Sunmary and Perspeetlves 

The paper hae atcei^ted to describa the ™ltiple rasearah mathodoleglas be- 
ing used to evaluate an Inservlee teacher education eurrlculum id^thln the frames 
work of a transaetisnal evaluation model. Preliminary results of less than one 
year of data collection and analysis were presented in aumMLry fashion. and some 
judgments concerning the limitations of each methodology were discussed. The 
ISiue t^^^^^^ is the evaluation productivity of the four research 

methodologies jaollectlvely and individually* Does each technique provide in- 
formation for wise declsioji making in the program^ raise new research questions, 
generate hypotheses and contribute to knowledge In the area of inservlce train- 
ing? Does the methodology peralt the accurate description of the program and 
its curriculum and does it yield measurable predictions of the behaviors of in- / 
dlvlduals and institutions? Do the miltlple methodologies co^lement each other 
or are they redundant? Is the supplementary information yielded by one tech- 
nique worth the staff time and effort devoted to the data collactlon and anal-^^.. 
ys is mandated by the construots of the avaluatlon model? Is there an effective 
and efficient sequencing of the methodologies? 

Preliminary judgments indloate the least productive model, not reported 
here, in terms of ganeralisablllty is the comparative case study methedc&logy. 
However, the results of this approach are important to the public school parti- 
cipants in the program by virtue of the detailed Information presented regard « 
ing one school and one cadre and one component of the complex program. The 
m5gt initially useful technique in tha quantitative one because of the lm- __L^ 
mediate information avallabie through surveys, needs assassments and post ineatlng 
reaction sheets. Program planners can. change formats j content of Insarvlce acti- 
vities and allocation of resources early in the program's history to respynd to 



these data. Participants seem to respond leii enthusiastically to quantitative 
^^iU'V^.^'i^BSback and ask for simple verbal stateTaents,:wliich can beM 



^0:^j:y^:::lkBB cave is taken^ The ability of the quantitative/ analysis method to raise|r# 
frf^J ; search -questions and generate hypotheses rests on the asBumpt ions underlying 

the coll.ection of the data. Thei quantitative iafca collected to generate status 



d'sscriptions tend not to lead to further eiamlna t ions • When the assumptions 
fie . r underlying the investigation posit a series of relationships such as students' 
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sense of self worth and their teachers' participation or nonparticipatlon in 
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an inservlce program, then a variety of speculations^^^^^ for. In- 

vestlgaSl^ir~R^esppns 
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gauged in a cost effective way through quantitative means thereby contributing 
to the literature in the field, Hiiwever, if quantitative , data. were the only 
descriptions available of the curriculum, the view would be narrow and not 
U highly predletive of behavior. Butithe baseline data provided by this tech- 

^|^T7 nique seem to be the logical starting point for all other evaluative models. 



The technique of managerial analysis begins with the program's start and 



continues Informally for Its duration. The attempt here is to make this im- 
pllcit personal evaluation process explicit. It may be that the technique is 
Ji£Vi3-ifV less an evaluation scheme than a management approach. But information is col- 
lected, processed, shared with other si and used to make decisions about the 
1 direction and performance of program elements* The power of t^e" method to 

generate hypotheses and raise research issues may be limited to the develop- 
ifmirit^ of selectioa models for staff, sites and resource jnanagement^ 
^ The historical methodology ^^^^ 

assessment. The technique is by nature eummative, but begins with the pro- 
gram's inception at the planning stage :if possible. The generation of re- 




|eearch,:que3tions and hypotheses from this technique depends on .the creativity 
; of:, the 'program and the skill of the historian." \ . _ : ,; 

Earlier the issue of redundancy emanating from the utilization of multiple 
f methodologies was raised. The experience to date reveals some . redundance of 
leffort ai^id the need to rethink the use of two of the techniques in-the evalu- 
ation design* However, the staff agrees -that the benefits derived ^^f^ 
multiple techniques and frameworks -far ^outweigh the problems encountered and 
the time expended. First, the use of morev than one technique and way ^ of "1^ 
ing at the curriculum allows the generation of questions which would not arise 
from the_ single^ approach^OTd^ further_p.rov_ldes__data_for_pQSsible_answera_to_ these 
questions. For example^ tha qumtitstlve attitude data reveal Hlnton students 
to be well above national norms on the variable of school affiliation, but be- 
low or at the national norm on Che variables of peer affiliation and teacher 
affiliation* Why? Informal interviews with participants and observations of 
relationships Mong students and between students and teachers Indicate that 
the school is perceived by students as a haven which provides warmth j food, 
physical security, and safety, from attack. Formal interviews will probe the 
issue further * V Second, the multiple techniques serve ael a validation device. 
Third, more than one approach to a problem helps to give greater focus to the 
research questions and gives insights into how to, sequence the : further collec- 
tion of data* - Fourth, the simultaneous use of more than one view, such as 
quantatlve and ethnographic, provides Information on the rdlfferentiair meaning 
of a set of data. Frequently, a mean score blunts what are really positions 
on either extreme . Observation and tatervlew data can Interpret the differ- 
ential effects of what appear to be ordinary responses. 

^^The moa t t ime consuming : method is the ethnographic one, but it tends to 
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yield the most comprehensive and provocative data about the socio-cultural 
ayetem and the Impact of the inservlce cuwiciatm* The analyses produced 
by this technique help clarify and integrate the data produced by the other j 
atrategies. This model seema neat compatible with the framework of the pro- ' - 
gram. The question of staff time Md-effort must be considered in programs with 
with limited resoiffces and it say be that other evaluation tecfiniques will 
need to b« ellnljiated to accOCTidata this one. 

Finally, the financing of education today discourages experimentation with 
hltfi risk training curricula. Increasingly, educators are being encouraged by 
-piAiic^ and-prtvate-so-^ees -to-Eepilcate_!!succeaafulll programs, _to_co_ns«ltJ:ke 



research and apply the findings to practice. Given this attitude, the body _of . 
empirical research upon which the curriculum planner and researcher may draw 
before deslpiing a curriculum should be expanded to Include carefully documented . - 
studies of the processes and outcomes of given curricula. This paper details ^ / 
the assessment of a complex curriculum to -the professional development of educa- > 
tors from the vantage point of fbur research aodels. Further, the methodologies 
are being used simultaneously and being compared in terms of the appropriateness , . . 
of the techniques in summative and formative evaluation. Judgments have been 
and are being made about the utility, of each method. Others who have the task-- 
of selecting models to evaluate the structure, function, content, patterns, and .^^ 
outcomes of curriculum sight benefit from information about which model does %>;^| 



what in ^assessing the curriculiaa. 



